UNCLASSIFIED 


AD  NUMBER:  AD0896849 

_ LIMITATION  CHANGES 

TO: 

Approved  for  public  release;  distribution  is  unlimited. 


FROM: 


Distribution  authorized  to  U.S.  Gov't,  agencies  and  their  contractors; 
Administrative/Operational  Use;  09  NOV  1977  Other  requests  shall  be 
referred  to  Office  of  Naval  Research,  Arlington,  VA  22203. 


_ AUTHORITY 

ONR  Itr  dtd  09  NOV  1977 


THIS  PAGE  IS  UNCLASSIFIED 


TM'S  REPORT  HAS  BEEN  DELIMITED 
AND  C! EARED  FOR  PUBLIC  RELEASE 

UNDER  DOD  DIRECTIVE  5200,20  AND 
NO  RESTRICTIONS  ARE  IMPOSED  UPON 
ITS  USE  AND  DISCLOSURE, 

DISTRIBUTION  statement  a 

APPROVED  FOR  PUBLIC  RELEASE; 

D I STR I  BUT  I  ON  UNLi M I  TED , 


SPECIAL 


*  ityw+fm  i.yr-t  <ft1?r  '-Hf,® 


PEOJEOT  WHIRLWIND 


jj)  Nov«sfla^^47  ]“ 


MATHMAIIOS.! 


Volume  8  of  32  Volumes 


D  D  C 

EC3EIELQD 

MW  15  1974 

osEmni 

— ^  Ei  ^ 


Servo inschon’l eras  Laboratory 
Maeoachuaetts  Institute  of  Technology 
Cambridge,  Massachusetts 


CONTENTS 


11*143 Summary  Report  No*  2,  Introduction  to 
Volume  8 

M-160,  Mathematical  Work  of  Project  Whirlwind,  by 

Pro  fee  ao  r  Philip  Franklin,  November  13,  194? 

M-32„  Numerical  Solution  Method,  by  Warren  S„  Loud, 
Novembar  18 ,  1946 

R4.14,  A  Numerical  Integration  Method,  by 
Warren  Sn  Loud,  February  34 D  1947 

M-61,  DlBCuenion  of  Numerical  Methods,  by 
Warron  S*  Loud,  March  17,  1947 

H-71#  Dlacususion  of  Determinant o  of  Large  Order  by 
Professor  Norbert  Wiener,  by  Warren  5„  Loud, 

May  1,  1947 

M-*78t  Solution  of  Equations  with  Minimum  Error,  by 
Warren  S*  Loud,  June  2 „  1947 

M«94,  Suggestions  for  Farther  Work,  by  Warren  Sc  Loud 
August  6,  1947 

M=950  Report  on  Wiener" »  Ideas,,  by  Warren  S„  Loud, 
August  11, ,  1947 

Mral03„  Mo  Ac  A„  feyntposiura  on  Computing  Machine  Yale 

University  on  September  3,  1947,  10  Ar.M,  *■  12  1' 
by  Edgar  Reich,  September  3,  1947 

M-124,  Location  of  Target  from  Combined  Observations, 
by  Professor  Philip  Franklin B  October  21t  1947 


M— ’142 


INTRODUCTION 


The  original  mathematical  work  on  the  project  was  started 
in  the  early  part  of  1946*  and  constituted  an  investigation  of 
methods  of  Interpolation  and  integration  to  be  used  in  the  solution 
of  tho  airplane  stability  contx'ol  problem,,  There  are  no  published 
reports  on  this  study  but  tho  results  wore  used  in  the  programming  of 
the  ASCA  problem  which  is  reported  in  Note  (L»16  in  Vol.  14. 

e/v<jo$€(  }n 

The  project  was  later  joineM}y==Brs==ho^^  an  in-» 

vestlgation  of  the  stability  of  tho  numerical  solutions  proposed  for 
the  airplane  problem*  This  study  included  inveotigatlono  of  simple 
linear  and  non-linear  systems,  and  oonsldored  the  use  of  mathematical 
filters  and  energy  conservation  methods  to  avoid  instability „jkJ3ome  of 
these  studies'  were  reported  in  M-32  and  in  IU114.  In  this  wcrekhe 
waa  assisted  by  Margaret  Floroncourt,  Kenneth  B.  Tuttle,  end  Edgar 
Holcho 

Storting  in  March  of  1947,  a  series  of  meetings  were  held 
between  the  mathematics  people  of  Project  Whirlwind  and  the  Mathematics 
Department  of  M.I.T.  M-Ql  by  Dr.  Loud  presents  some  ideas  for  a  coups® 
in  numerical  methods  disoussed  during  these  meetings*  Profeasor  Norbart 
Wiener  of  M.X.T.  waB  present  at  these  meetings  and  presented  sora® 
important  ideas,  two  of  which  are  discussed  by  Dr.  Loud  in  M-71  and 
M»»78.  Later,  a  study  was  begun  on  the  application  of  Wiener^  statisti¬ 
cal  filter  theory  to  the  probleane  of  numerical  solutions*  A  part  of 
this  work  ie  reported  by  Dr.  Loud  in  M~94  and  M~95. 

Dr.  Loud  left  the  project  for  mother  university  during  tho 
summer  of  1947.  The  mathematics  work  on  the  project  was  then  put 
under  the  guidance  of  Professor  Franklin  of  MdI.T.^s  Mathematics 
Department.  As  part  of  the  work  since  that  time,  an  investigation  has 
been  mad©  of  probability  methods  useful  in  the  correlation  of  radar 
and  other  data  useful  in  such  problems  as  the  airport  control  problem. 
Part  of  this  ivork  is  reported  by  Professor  Franklin  in  M-134.  M-1QQ 
la  a  trip  report  on  a  computing  machine  symposium  attended  by  Edgar 
Reich. 

The  present  mathematical  work  of  Project  Whirlwind  as  wall  as 
plans  for  future  work  are  dlooussed  by  Professor  Franklin  in  14-160. 
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Project  VMr.lv/ ind 
S  ervoma chanisms  Laboratory 
Massachusetts  Institute  of  Technology 
Cambridge  ,  Massachusetts 


SUBJECT; 

MATHEMATICAL  WORK  OF  PROJECT  WHIRLWIND 

To; 

Jay  W®  Forrester 

From: 

Philip  Franklin 

Date; 

November  12,  1S'4? 

T„  Tho  Mathematics  Program 

The  projected  Whirlwind  high-speed  electronic  digital  computer, 
from  the  mathematical  point  of  view*  has  several  objectives®  One  aim  is  to 
solve  the  equations  of  motion  for  aircraft  and  so  serve  as  ^e  computing 
element  of  an  aircraft  analyzer®  A  more  general  objective  la  th©  solution 
of  other  problems  of  engineering  interest,  particularly  in  the  ilexa  o.T. 
dynamics  and  ordinary  differential  equations® 

The  mathematical  studies  in  the  past  have  related  to  the  specific 
equations  to  be  solved,  some  tests  of  existing  numerical  methods,  and 
attempts  to  anticipate  possible  difficulties  with  a  view  to  proscribing 
how  to  meet  them0  At  present  a  study  of  known  methods  of  solving 
simultaneous  linear  equations  and  differential  equations  is  under  way,  wi 
a  view  to  the  coding  of  such  methods  for  the  conputer0  These  studies  will 
be  extended  to  other  types  of  problems,  such  as  those  listed  in  Section  -U-U 

II*  Studies  Already  Completed 

A  survey  of  numerical  methods  mads  by  Dr„  loud  and  his  associates, 

summarized  lii  Mamorano.um  H~61  Ool,  «),  revealed  as  snbjscteot  i^rtanze 

the  solution  of  linear  simultaneous  equations,  and  the  solution  of  ordinary 
differential  aquations® 

For  the  solution  of  .linear  simultaneous  equations,  elimination 
methods*  iteration  methods,  relaxation  methods,  matrix  methods,  and  the 
mothod  of  steepest  descent  have  all  been  considered  and  expositions  of.  these 
methods  studied.  For  some  of  these,  codes  ar®  in  process  of  preparation. 

•  The  errors  inherent  in  solving  systems  of  equations  of  very  high 

order*  when  all  of  the  coefficients  have  random  errors,  has  been  pointed  out® 

A  number  of  solutions  have  been  carried  out  for  simple  differential 
equations  to  provide  case  histories  of  accumulated  round-off  and  truncation 
errors o  Those  indicate  the  objections  to  numerical  integration  over  a  largo 
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numb or  of  cycles  without  some  check,,  such  as  the  use  of  the  energy 
integral  for  conservative  systems 0  The  possibility  of  filtering  out 
frequencies  corresponding  to  computational  instability  terms  has  also 
been  consideredo 

A  method  of  ufing  Fourier  Transforms  to  estimate  the  best  value 
of  a  function  or  its  derivative  (the  message)  when  its  values  over  a  long 
range  are  known  only  to  within  certain  random  errors  (noise)  was  presented 
to  the  group 0  Later  studies  indicated  this  as  having  restricted  applica¬ 
tion  to  computation  because  of  the  rare  occurrence  of  data  with  truly 
random  errors  0 

Last  year  several  conferences  were  held  at  M„  I,  T„  on  digital 
computation „  Some  were  sessions  of  the  Electrical  Engineering  Department 
seminars  but  were  well  attended  by  representatives  of  the  Mathematics 
Department  and  Project  Whirlwind*.  Another  series  of  smaller  conferences 
were  attended  by  some  electrical  engineers  s  including  Professors  Haaen  and 
Y0  Wo  Lee,  as  well  as  several  members  of  the  Center  of  Analysis 0  The 
mathematicians  present  included  Profeesors  Phillips,  Martin,  Wiener @ 

Franklin,  Wallman,  and  Thomas,, 

In  addition  to  these  men,  several  other  M,  I.  T„  staff  members 
have  shown  an  interest  in  electronic  computers,  and  a  willingness  to  give 
advice  when  problems  in  their  special  fields  are  considered,,  Thus,  if  shock 
waves  are  under  consideration,  advice  can  be  obtained  from  Professor®  Tsien 
or  Lin  or  Dr,  Kopal,  who  are  all  familiar  with  this  field*  For  elasticity 
problems  and  their  theory  Professor  Reissner,  for  statistical  and  meteoro¬ 
logical  applications  Frofessor  Wadsworth,  and  for  general  numerical  compu¬ 
tation  Professors  Hitchcock,  Crout,  and  Hildebrand  are  available 0 

The  many  members  of  the  M.  I.  T.  Mathematics  Department  who  are 
interested  in  numerical  computation  contribute  much  information  about  recent 
developments  through  informal  discussions  0 

In  addition,  the  staff  members  of  the  project  have  attended 
meetings  at  Princeton,  Philadelphia,  New  Haven,  and  Cambridge  at  which 
computing  methods  were  discussedo  And  the  group  has  followed  recent 
developments  in  the  theory  of  codes  and  numerical  computation  at  Princeton, 
Harvard,  the  University  of  Pennsylvania,  and  elsewheroo 

III,  Plan  for  Future  Investigations 

Certain  problems  of  interest  to  applied  scientists  and  engineers 
can  b©  moat  conveniently  solved  by  numerical  methods 0  Classified  mathematically, 

the  principal  types  are  as  follows; 

lo  Solution  of  ordinary  differential  equations  with  given 
initial  conditions*. 

20  Solution  of  parabolic  and  hyperbolic  partial  differential 
equations,  obtaining  the  characteristics  curves  as  in  L 

3  6  Solution  of  systems  of  linear  simultaneous  equations*, 
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3c 


4c  Solution  of  ordinary  differential  equations  with  boundary 
conditions  at  more  than  one  point 0 

5o  Solution  of  elliptic  partial  differential  equations  for 
various  types  of  conditions  on  the  boundary  of  a  region,, 

60  Solution  of  non-linear  simultaneous  equations 0 

7c  Least  square  solutions  of  overdetermined  systems  of  the 
types  of  3  and  60 

8c  Solution  of  integral  equations 0 

9o  Tabulation  of  functions, 

While  the  relative  advantages  of  different  methods  may  change 
in  the  transition  from  hand  or  desk  calculations  to  high-speed  machines, 
it  I3  improbable  that  .any  radically  new  mathematical  principles  will  come 
into  play0  Much  past  and  recent  experience  bears  this  outQ 

Thus,  the  methods  used  by  Aiken  in  computing  tables,  or  by  the 
Watson  Laboratory  in  checking  the  moon ' e  motion,  bear  strong  resemblance  to 
those  long  known  to  astronomers  j  and  except  for  the  use  of  conditional 
orders  the  methods  used  for  elementary  functions,  such  as  those  coded  for 
the  AoR.C,  by  Booth  and  Britten,  would  have  been  used  by  Babbage  in  the 
nineteenth  century  if  he  had  completed  his  analytical  engine, 

/■  Again,  the  report  on  linear  equations  by  Bargmarm,  Montgomery,  end 
von  Neumann  recommends  as  the  two  best  methods  an  iteration  rule,  Btated 
by  Hotelling,  which  amounts  to  an  application  of  Newton's  method  of  approx¬ 
imation,  or  an  elimination  method  which  is  that  used  by  most  computers  in 
such  forms  as  those  of  Doolittle  or  Grout 0 

And  except  for  minor  details  of  technique,  the  differential 
analyzer  uses  mathematical  methods  differing  little  from  those  used  by 
Kelvin  in  evaluating  special  integrals  with  his  globe  disk  and  cylinder 
integrator „ 

This  suggests  that  the  first  attack  with  the  computer  on  the 
problems  listed  above  should  be  by  processes  close  to  the  traditional 
ones.  Of  course,  two  special  points  to  be  covered  in  taking  over  existing 
methods  are  the  coding  of  complete  instructions  to  remove  any  human  judgment, 
and  keeping  the  high  speed  from  letting  us  carry  the  computations  beyond 
their  range  of  validity,, 

The  present  thinking  on  procedures  for  the  various  types  of 
problems  is  as  follows: 

lo  Ordinary  Differential  Equations,  One  Point  Conditions 

For  systems  of  ordinary  differential  equations,  some  method 
using  second  differences  or  their  equivalent  such  as  the 
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Runge-Kutta  method  or  th©  Moulton  (Adams,  Krilof f )  methodo 
This  last  may  be  used  in  the  form  set  up  by  Ford,  which 
uses  linear  combinations  of  the  numbers  instead  of  differences o 
After  several  steps  have  boon  taken,  th®  results  can  bo  checked 
and  improved  by  a  Simpson's  rule  calculation  which  would  hav© 
a  smaller  round-off  error  than  the  result  obtained  step  by  st©p0 

Characteristics  of  Partial  Differential  Equations 

Moot  of  the  procedure  is  ao  in  1,  the  now  feature  being  the 
cut-off  due  to  an  initial  boundary  or  the  meeting  of  some 
conditional  bounding  condition  like  that  for  shock  waves 0 

Linear  Algebraic  Equations 

For  systems  in  20  or  fewer  variables,  an  elimination  method 
can  be  used  and  coded  with  about  80  orders  0  The  matrix,  iteration 
procedure  F  s  P  (2-AFk)  to  obtain  A'*S  the  limit  of  Ffc,  may¬ 
be  useful  for  more  variables  or  where  a  system  must  be  solved 
for  several  right  members  0  A  steepest-descent  method  on  the 
sum  of  the  squares  of  the  residuals  may  be  useful  for  a  large 
number  of  variables. 

In  many  applications  where  numerous  variables  are  met,  the 
system  is  loosely  coupled  in  the  sense  that  effects  in  one 
place  affect  values  at  a  distance  only  slightly.  Here  much  of 
the  difficulty  of  treating  a  large  matrix  with  all  values 
equally  in  error  disappears  0 

Systems  with  determinants  near  aero  will  have  to  bo  recognized 
as  such  at  some  stag©  of  the  solution  process,  and  the 
recognition  used  as  a  halt  signal. 

Ordinary  Differential  Equations,  Bounds  Conditions 

This  situation  will  b®  met  by  reduction  to  an  integral 
equation,  by  an  expansion  in  known  functions  whoso  co-efficients 
are  found  by  solving  linear  equations  (Ritz,  Galerkin,  Fourier), 
or  from  solutions  found  as  in  10  For  conditions  at  two  points 
ve  use  a  family  of  solutions  starting  from  on®  point,  and  inter¬ 
polate  to  moot  tha  conditions  at  the  second  point.  For  linear 
differential  equations  with  conditions  at  several  points,  we  may 
use  a  linear  combination  of  independent  solutions  found  numeri¬ 
cally,  evaluating  the  constants  by  solving  a  system  of  linear 
algebraic  equations , 

°  Elliptic  Partial  Differential  Equations 

Linear  partial,  differential  equations  of  elliptic  type  are 
reduced  to  difference  ©qxiatlons  on  nets.  In  a  two-dimensional 
problem,  if  our  machine  eventually  used  say  64  points  on  a  square 
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it  might  be  advantageous  to  got  a  first  approximation  for  a 
4  x  4  grid  by  solving  simultaneous  equations ,  then  interpolating 
on  this  for  a  first  approximation  on  an  8  x  8  grid,  which  could 
be  improved  by  scans  successive  approximation  scheme  or  relaxation 
method*  Relaxation  methods  by  machine  have  the  difficulty  of 
requiring  a  large  number  of  comparison  orders 0 

1WI  will  probably  be  able  to  work  two-dimensional  grids  of  fairly 
fine  dimensions,  but  possibly  only  crude  throe-dimensional  grids, 
like  those  now  used  by  hand  in  two-dimensional  problems , 

Mon-Linear  Algebraic  Equations 

Iteration  procedures  are  usually  successful.  The  cod©  would  have 
to  make  possible  the  insertion  of  an  approximation  at  different 
points  in  a  loop,  only  continuing  if  the  successive  values 
clustered  after  a  few  tries 0 


Gauss  procedure  reduces  this  to  6  and  3, 


8,  Into* 


Approximation  of  the  kernel  by  a  degenerate  one  reduces  linear 
integral  equations  to  3,  or  we  can  express  the  solution  aa  a 
linear  combination  of  known  or  determined  functions  as  described 
under  4  above, 

9*  Functions 

Our  machine  will  probably  tabulate  functions  only  for  its  own  use. 
Functions  *111  be  inserted  either  through  discrete  values  and  an 
interpolation  program,  or  by  using  polynomials  that  approximate 
the  functions  in  restricted  ranges  and  calculating  the  polynomials. 

In  some  cases  the  approximating  polynomials  may  be  found  by 
approximating  some  higher  derivative  and  integrating. 

In  addition  to  general  methods,  several  aspects  of  the  specific 
application  of  the  computer  to  the  analysis  and  control  problem  will,  be 
considered.  Thus,  the  detailed  equations  and  constants  for  different  types 
of  service  and  air-borne  craft  will  be  investigated, 

Sorno  preliminary  studies  of  the  mathematics  of  correlating 
statistically ,  at  information  centers,  data  from  radar  stations  will  bo  continued, 

IV ,  The  Practical  Estimate  of  Ergo r 

While  existence  theorems  are  nice  to  have  when  they  can  be  obtained, 


/ 
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much  numarlcal  work  proceeds  successfully  without  them,,  For  example 
astronomers  guessed  right  on  c  emi-co mrer g ent  asymptotic  series  before 
they  were  understood  by  the  purists 0  Series  with  coefficients  obtained 
by  sums rical  methods  are  used  to  predict  the  moon5 a  position  years  in 
advance,  but  the  stability  of  the  system  of  sun,  earth,  and  moon  under 
the  known  in.itial  conditions  has  never  been  established  with  complete 
mathematical  rigor 0  Many  of  the  iteration  processes  used  to  find  roots 
of  equations  can  either  converge  or  diverge  rapidly0  By  comparing,  say, 
a  fourth  and  a  fifth  approximation,  and  sensing  the  size  of  the  discrepancy,, 
our  machine  will  recognize  the  process  as  finished,  promising  for  further 
approximations,  or  useless  for  computation  because  of  divergence  or 
excessively  slow  convergences 

A  large  percentage  of  recent  numerical  computation  for  partial 
differential  equations  has  no  other  justification  than  that  th©  results 
seem  to  convolve 0  Undoubtedly  many  MI  and  Mil  solutions  will  use  such 
evidence,  for1  lack  of  anything  better,. 

Because  of  th©  labor  of  making  codes,  high-speed  machines  will 
bo  chiefly  used  for  whole  fields  of  solutions  0  A  certain  amount  of 
experiment  on  the  mac  bin  o  may  bo  needed  at  the  start,  but  one©  verified 
for  a  few  cases,  the  method  will  extend  to  the  whole  field, 

Simila?  considerations  apply  to  formulae  for  the  size  of  th® 
error,,  Those  are  seldom  used  lit# ©rally,  bscaus©  If  rigorous  they  are  apt 
to  bo  much  too  pessimistic  In  practice,,  iit  best  such  formulas  are  merely 
useful  to  prove  convergence;  a  comparison  of  successive  values  then 
©atimatos  th©  error  0 

In  many  problems  the  stability  of  tho  method  of  solution  can  bo 
predicted  in  advance,  and  a  largo  number  of  solutions  differing  s lightly 
are  to  b©  found,  Hero  tho  smooth  character  of  th©  results  is  a  raaeonabl® 
protection  against  excessive  errors  at  any  place,, 

In  other  cases,  some  form  of  a  successive  approximation  method 
will  be  used.  When  the  process  succeeds,  tho  clustering  of  the  approximations 
servos  both  to  check  the  results  and  to  provide  an  estimate  of  the  closeness 
of  approximation. 

When  the  succassive  approximation  method  fails,  some  order  to  test 
the  closeness  of  approximations  after  some  set  number  of  steps  will  lead 
either  to  a  hal'c,  signal  or  to  an  alternative  procedure,,  Thus  in  a  loop  process 
th©  alternative  may  bo  another  starting  point  in  the  loop.  In  a  step-by-step 
process  the  alternative)  may  be  the  use  of  smaller  steps 0 

In  many  solutions  of  ordinary  differential  equations  by  the  KouLton 
method,  the  use  of  a  Simpson’s  rule  integration  ovor  large  intervals  may 
prevent  the  piling  up  of  round-off  errors  0 
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Vo  The  Influence  of  Mathematics  on  the  Design  of  Will 

The  specifications  for  WWI  we re  sot  up  with  the  aim  of  providing 
a  prototype  capable  of  performing  all  the  operations  desired  from  a  computer, 
on  a  scale  largo  enough  to  b©  applied  to  many  typical  situations,  and  suffi¬ 
ciently  limited  to  be  eoruitructabl©  in  reasonable  time0  However,  within  this 
laa(/  limitation,  it  was  found  feasible  to  provide  for  greater  speed  and 
storage  capacity  than  'any  existing  digital  computer  possesses,, 

Th®  types  of  desired  mathematical  operations  are  fairly -well  known; 
namely,  the  four  fundamental  arithmetic  operations,  and  certain  logical 
operations  such  S3  shifting,  digit  transfers,  aubprogramming j .  and  conditional 
eubprogrammlngo  From  these  fundamental  elements  any  finite  combination  of 
computational  processes  can  be  built  up0 

The  mathematician's  requirement  is  that  those  operations  b©  performed 
either  directly,  or  by  combination  of  other  operations 0  Thus  division  or  square 
rooting  can  bo  ©ithor  built  in  as  special  operations,  or  carried  out  by  a  sub¬ 
program,  Th©  present  plans  call  for  a  built-in  division  unit,  and  th©  possi¬ 
bility  of  including  a  few  special  orders  which  would  enable  the  operator  to 
call  for  any  particular  subprogram,  as  that  for  square  root , 

Considerable  study  of  binary  arithmetic  and  the  conversion  problem 
showed  the  feasibility  ana  advantage  of  having  the  computer  work  in  binary 
arithmetic  but  translate  data  and  outputs  from  or  into  the  decimal  notation, 

A  guiding  principle  of  the  WWI  specif  ications  has  been  maximum 
flexibility o  This  will  simplify  the  extension  to  .larger  models,  and  will 
increase  the  effective  power  of  the  computer,  for  example  by  allowing  an 
arbitrary  distribution  of  the  storage  capacity  between  numbers  and  orders c 

Beyond  the  fundamental  questions  just  mentioned,  and  verification 
that  the  computer  has  sufficient  speed  and  capacity  for  certain  specific 
problems  such  as  that  of  aircraft  control,  mathematical  considerations  can 
have  little  effect  on  the  basic  design,, 

With  regard  to  overall  capacity  of  later  models,  experience  with  Ml 
and  theoretical  considerations  can  only  dictate  ratios  of  components,  rather 
than  absolute  Biz©0  For  the  siz©  at  any  stage  will  always  bo  limited  by 
economic  and  engineering  factors 0  Any  machine  is  certain  to  have  just  a  little 
less  capacity  thari  that  required  for  some  desired  applications 0  1  For  WWI, 
sufficient  capacity  for  tho  aircraft  problem  seems  to  b©  the  only  fixed  require¬ 
ments  that  is,  it  should  have  sufficient  speed  and  capacity  to  be  used  as  a 
computing  link  in  the  aircraft  analyzer 0 
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Numeric 

J  Jjii’M? 

Novembe 

Suppoca  £  (y)  and,  vie  wish  to  set  up  a  numerical 

sc3.ut.ioji,  with  a  step-by-step  proceoc*  -let  the  interval  between  otooo 
be  ja,. and- aDflUMe  the  values  of  y  at  0,.  h  3hP3hr  *  -nh..  «r&  kmm ,  Tiio  win. 
at  U+l)  h  will  be  found  as  foUowsi  “ 

lo  Extrapolate  the  solution  to  (zv4’l)h  by  bobs  means ^ 

f  { ' y  1“ J  llV. 

2»  Integrate  by  some  nsoanaJ  j  ' 

s'  ^  sh 

«  c„,..  „  „  ...  '  (ntl)h. 

Efi-l  'a  /  •  f\y)dt 
c/nh 

Tor  8Ri.ll  enough  values  of  h,  they  will  follow  th©  true  solution  closely «. 

Notes; 

lo  3?ho  extrapolation  procedure  might  be  a'  linear  process,, 
i»3c ;  extension  of  the  solution  from  (nb.c  y  )  by  a  straight  IJ.no « 

i'his  may  be  the  line  through  Jjn~l)b..  y^  ^  j  r.  Jnhj,  y& 

ba  the  line  through  (nb ,  y  )  with  slope  equal  to  S  (y  ) . 
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Again  we  may  us©  parabolic  extrapolation  using  y  y  and 

•  -  Bn  Vr-i. 


J  „  or  using  y  ,  y  plus  the  slops  at  y 

Ju>ra<o  St  D. 


2o  3?h©  integration  is  the  area  winder  x  j  y  (tjJ  where  ,y  (t) 
ie  the  extrapolated  curves  A  linear  or  parabolic  approximation  in 
niads  o 

V.h.2  method  was  extended  to  a  second  order  equatiouc  Consider  the  squat  lot 

« 

y  ™  -Jr 

j  (i 

If  y  --  V.  v  »  -y  find  we  have  simultaneous  first  order  equation®. 
Let  ue  use  linear  extrapolation  and  iafcogratione  using  the  point  and  the 
slope c  Tho  extrapolations  are  then; 


JJS4  5 

Msaoran&um  i.'o  K-32 


•2- 


* 


y  ■»  ya  ♦  \  i  t  -  »*0 

v  ~  v„  -  y  (  t  -  alO 
n  n 


Tho  Integrals  from  t  =  rih  So  C  rr*-3.)  h  of  -‘•f-  and  ~rf~  arr.  respectively 

*  Clw  CL  Vi 

li3  ha 

hv  -  —  y  and  ~hy  —  v  co  that  tho  novf  poinfeo  arc 
n  2  n  ‘iv  ?.  t. 
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*!•  h  v 
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"a 

equations  can  he  solvod  to  give 

n 

,vn  =  r 

[" yQ  coc  a 

p  *:•  7q  sin  a  f^J 

n 

v  «  r 
n 

pyQ  nln  a  {' 

v  vq  coo  n  <TJ 

~jr 

whera  r  “  J  1+-— 

find  tan  £  c 

h 

X“  h/3 

If  plotted,  letting  t  =  nh«  and  Dotting  yQ  C  vp  =  1  no  that 
tho  true  eolation  la  y  =»  sin  t,  vco  find  all  t.bo  points  be  on  the  ootyo 

£ja.  < 

y  »  o  p "  oln  wt  where 
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Thuo  the  approximate  solution  would  bo  (5.f  linear  interpolation 
i3  used)  a  euceosoion  of  chords  of  tho  carve 


y  =  e 


fit 


sin  wt. 
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1„  If  more  complicated  extrapolation  and  integration  Is  t  sod, 
tho  point  Bar  *5  on  a  curve  whose  equation  it.  of  tho  fora 

tj ,  t  -  (Jat 

y  c  o  ~  Bin  Vx t  *v  >3  1  olu  \l;>»  •>  *  °  t 

whore  for  email  h  all  tho  fl'Ja  tut  o no  ar  o  largo  and  negative* 

4^ 


ior&ndnm  H 


So  It  happens  that  for  all  methods  tested  the  value  -of  p 
it  definitely  positive  for  large  values  of  h.  This  produces  had 
divergence*  She  worst  values  asera  to  come  for  b.  »*  3,  hut  fi>  0  for 
b.^2  in  moat  Bases*  In  the  method  explicitly  do  scribe &*  p  >  0  for  all 
values  of  he 


3*  If  damping  was  introduced  into  the  equations 
became  positive  for  large  h .-> 


4o  In  a  system  with  two  natural  frequencies,  y  *>•  101  y 
lOOy  =:  0  with  h  »  0.Vjt  which  is  SO  point  o' per  period  for  the  w  1 
component  hut  only  2  points  par  period  for  the  v  »  10  component,  the 
divergence  van  pre-scat  and  not  suppressed  duo  to  the  small  number  of 
stops  per  period  in  the  high  frequency  part* 
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la  connection  with  tho  eolation  of  the  aircraft  equations, 
it  was  thought  desirable  to  study  tho  various  poasibiXlM.es  for  stsp^by-otep 
solution*  The  principal  method  under  consideration  might  well  be  called  tho 
extrapolation  and  integration  method*  Xt  is  with  the  character! sties  of 
this  method  that  this  report  deals,,.  The  discussion  is  centered  about  it  a 
application  to  vibrating  systems,. 

The  following  ia  the  method  for  a  first  order  equation.. 

The  type  of  equation,  handled  is  dy 

it  " 

A  etop'-bywatep  solution  ie  aet  up  as  follows?  Let  b  bo  a  small  interval  in 

time,  and  -assume  the  solution  to  b®  known  at  t  0,  h,  2h„  {u--l)h*  Let 

tho  values  of  y  at  theca  points  be  y  ,  y- ,  ;r0„  y  „  -The  value  of  y 

«  j.  u  jy"J.  _  ,  *  n 

is  found  by  a  two-part  process*  First,  tho  function,  f  [  y(t)  i  as  a  .-function 

of  t  ia  extrapolated  from  t  ~  (n~l)  h  to  t  ~  ah*  Second,  this  function  S. ki 

integrated  from  t  »  (n<~l)h  to  t  =  nhj  the  value  of  the  integral  ire  added  to 

to  obtain  y  *.  St  is  shown  in  tho  theory  of  differential  equations  that 

tho  true  solution  will  be  obtained  within  any  desired  approximation  for  com© 
length  of  time  provided  that  h  ia  taken  email  oaough* 

The  methods  of  sxtrapol&tion  and  integration  may  be  chosen 
from  a  number  of  possibilities*  The  most  usual  methods  are  linear  and 
parabolic*  A  linear  extrapolation  would  bo  extension  of  t  },y(t)p  bjr  a  straight 
line®  This  lino  could  bo  the  line  through  the  point 0  \  (a*3)h»  f(y  ,*)]  and. 

L-j  _  5,  U'^i  J 

(n^l)h.8  f(y  )  I  *  It  could  also  be  the  line  through  the  paint 

^(n~l)h,  f(ya^p )Jhaving  tbs  slope  P  (y^  /•  f (y  .,  )»  Xf  the  function  f(y) 

ie  simple (so go  linear)  this  last  is  not  difficult  to  compute  and  there  is 
the  advantage  of  simplicity  in  analysis*  Similarly,  a  parabolic  extrapolation 
would  be  extension  of  f["y(t)J  by  a  parabola,  either  that  passing  through 
j[(n«3)h,  fCy^g)]  ,  £(®~2)hf*  £(yn^}J  end  f(n-3)hp  f  (y^.  )]  or  that  passing 

through  the  second  two  of  those  and  having  the  slop®  £ 8  (y  ..  )  f(y  ..  )  at  the 

point  for  t  sc  (a^l)ho 


,  ,,  ,  ,  ,.'•  j»U,  .••{  ,  iii.'i  ••»*  I  ,.,;|i:  u 


-f.V  •’,«•  :.!  '  :\;>.  *'•■>“•  ••■'••:  :  •  :.-'•■:,!  ■  if- ';  I'.,:  •••  l '-\,:Vi; 
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la  certain  cases  the  values  y„,-  y,  s  3'i  ate..  can  "be  found 

q  .1.  «u 

63<plicJ.tly«  For  exemple,  let  the  .  equation  be  ^  aad  lot  the 


.  at 


aztrspolatlon  method  bo  linear  rising  the  slop©..  'the  extrapolation  mill  bes 


Integrating  from  (n»l)h  to  nh  end  adding  y  we  .obtain 

yE  =  Vi +  h  ^vd  '■■  -S’  •  A  {^.i) 


v  s  y  ,  FI  4-  h4  +  &ljrl  1 

iJe  *»-i  L  \r  ,  J 


This  difference  equation  has  the  solution 


y  *  3-  (1  +  M  +  *&£)n 

U  v 


and.  If*  v;o  replace  n  .h  by  t,,  wo  obtain 

(  r.  .  , .  . 


y0  \  [} 4' 


+  h®An]  2VT 


ho  that  the  values  y  ,.  y, ...  y  .  -  .li?>  on  the  ctro 

V  J-  «A 


/  •  -  1  ) 
y  \  |x  +  M  t  h®4Sl|  ''ih  \ 

0  L  S  J 


spaced  a  distance  h  apart  in  t.  If  i-*o,  since  lim  'X  +  Ah  +  Jj£h®  ) 

t  H*?>q  2 

wo  obtain  y  "  y„  ®  11  which  is  the  tra©  solution. 

Q 


PARS  H  «  Application  to  Vibrating  System* 


She  principal  study  of  the  motto d  described  was  Its  application 
to  vibrating  systems.  -The  Investigation  was  limited  for'tlx  moat  part  to 
the  equation 


AX.  +  y  =,  0 

dt s 


which  is  the  equation  of  a  linear4  undamped  vibration.,  The  analysis  of 
the  numerical  solution  of  this  equation  could  be  ions  quits  completely.  So 


r  **qfr*'  UQUMKirKW 


W  '  c^rr  **•*’"  *or»r» 
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begin  with,  vo  jsiehe  two  first-order  equation® 

dy  _  ;  dT 

M  "  '  "ST  7 

Thogo  aro  special  cases  of  the  general  typo  Si  -  f(y,v);  «  g(y,  v) 

dt  ok 

wh?.ch  the  mo v, hod  dcccrlbod  would  handle,  The  fcuiofclooc  to  ba  axtrapolatod 
aro  thus  y  Gnd  v  themaolvoGc 

A&  -  A  complete  dlfloncslon  of  the  solution  will  be  given  to"  bho 
c&no  of  linear  extrapolation  end.  Integration.* 

1)  lirtrcnolatloc.  and  Integration 
s 

Sappose  that  y  end  v  hara  boon  evaluated  for  %  -  0, 
h  2h#  c .« (n-l)h.,  We  must  extrapolate  y  and  v  using  y^  ,  and  v  ,» 

Tht.  nan  ara  vft^  and  -y^,^  respectively,  20  the  extrapolated  '.lines  aro* 


y  “  Vi  +  Vi.fc  -  (c'a)^ 
T  -  Vl  *  7a~l  b  ~  '•“’a  ,b] 


Integrating  from  t  3  (n-l)h  to  b  »  nh 


^  nh 

\  ^  “  ^*-1  +  ”  Vl 

^  (n-l)h 


)  vdt  “  hVl  ~  ~~  }n,4 

The oa  integrclB  are  combined  wl bh  y  ,  and  v  to  obtain  y  and  v 

n—J.  n-l  a  n 


=  y  ,  +  \  vdt  =  y  -  (2  «  «JV-  )  +  hv  I. 
n-1  l  u*l  z  '  n- 1 


/(n4)Ji 


tnsx 

i  yd'o  3  v  .,  (l  •  -si- 


)  -  hy  - 
*  n-.\ 


'  (iHl)h 
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I  to  last 

nth  ■  . 
to  exasiiao 


it  k  .  -  .  -  f;w  1  ■ 

ii  it  ooeaiW.e  to  obtain  voa  ’i  a».  rvuo^:.;^:.  ;  i 

no  ioa  i  .  !  :  o:  ■  t  j  by  top  proc 


GO  ':'P 
.J)-’''.  'i'V.i’J 


53  •  ooJ.utlo/1  of  the  i)\:- 


An  I  important  step  in  the  analysis  oi  a  nwnorfea*.  m^iuot. 
of  the  t,ypo  wider  dlixusoion  i  s  the  aciution  of  illlfercao©  cquationt: 
An  exp3.anatS.oa.  of  ho  necessary  oapDCisj  of  differmoo  oqurttl.on  /hoor 
-.#12.1  ho  given  .  A  dlfferanoo  oquat.lon  with  c:ae  pair  iown  hue  the  ::o.ti 


f,-ya’  5Vr 


She  typo  wo  ahal3.  consider  will 
a»i  of  the  fo-rm 


n)  =£  C 

he  Hi  onr  with  constant 


oooffio  .ante 


\  "a-tp 


J, 


J  p4L  jr'-; 


ffp  1 


She  wethod  of  nolution  la  exactly  annl ogouc  to  cliti  solution  of  tinea:.* 
differential  o qu.a t lone  with  c-matcnt  coofflcteatci,  tot  the  c-pei'a'-or 
K  bo  that  of  increasing  the  index  by  3.  'Ll.. 


E  y,i 


SI  V 


then,  the  euuatien  bexoiJtoa 


<V? 


+  A  ,  K>J"'  +  *  A  )  y  »  0 

p-V  <«  ai'. 


uhloh, e.a  in  the  dlfforo.it3.il  aquation  caoe}may  'ire  factored  Into 
'  a  (R- 1,)  (E-rJ  ...  (S-r  >  jr 

p  j-  x?  p  n 


‘.P.hs  solution  of  the  ,  ltnplo  equation. 

(K-^r)  «  0  or  ya+;i  «  =•  3', 


la  seen  to  he  yR  =  e:-a  whore  o  de  <?,  coziiitenL  '.Phc  uorqilotv  oolutioa 
of  the  difference  equation,  ia  then 


n 


Vl 


n 


'  s.  .  ,  n 

•>r),;  ■'V  *  e  *  o  C  4 

O  P  J 


3b  r  aacaapls,  ooneftdnr  *;ho  oquertlcrt 


'V:-3  *  :5yu~,l  *  2yn  * 


0 


i  !?.,,„  U*-U& 


a,n!  «jljT'T)0 <1JD  V  ,!.!.-o  Y  7  n  wesIJa'.C  V-.:J..'.v  oqij.C.ti'.'sJi  &UT&C  C xy ,  .V'J  i!i  "OV.Tit. 

.....  .  w  ... 

thav. 


y3  ”  3-3»  y3  -  y^  «  4i?  •  o  , 

Ei  tra  ral-v-e  the  equation  (E3  -  3K  +  3)  y.„  «  0,  the  rocts  are  X  «  3  ar;;l 

s  ta  3.  80  that  y  s#  o  „  T'  •!•  i?,,  .  3*\  1'iic  laitluX  conditions; 

Y  *  4t  y_  «  ?,  give  c,  -4-  «„  «  4;  o,  4  2a  -•*  "%  so  th.it.  u  **  ,tc  o„  «  3- 
I  I1L  i  *  •»■  »  *• 

end  y  «  1  +  3  •>  3  » 

Xn  13 ago  t.ho  root 8  ere  not  distinct,  or  or®  coKplea,  nodiiJxationo 
analogous  to  the  differential  equation  case  met  he  rood©*  Sines  the  oats© 
ijf  oo:nolex  roots  i  g  inport  out  t  lot  us  con  older  iiuofe  a  <j«?.q®c  .uofe,, 


"ynd3 


u  y*a  +  yn  «  sad  lfct  yQ  st :--  h  2t 


(E3  +  B  d  l)y  «  0  *  E  «  «  ±  1 

>•*  ' 


JL-«.  co  s  X/;0  v  i  sis.  j.yt 


y  a  c,  (cop  130°  +  1  sin  .130°  )’1  4  c,foo»  ISO4'  -  :v  sia  X20v)n 
c'n  1 '  * 

«  c.  (ocs  a  .  ISO0  d  i  sin  a  «130°)  d  o,,{oo«  a  *  120*  -  1  sin 
i  * 

k  (a  +  ft.)  COB  (n  o  .120° )  d  1  (c,  •-»  o  )  sin  (a  *  ISC' 

’  X  vJ  •?•  • 


C  .1.  *d,c 


and  since  y  le  roalB  we  cart  writs 


'n  ;> 


o  oo «  (a  °  1209)  d  3,  sin  in  •  X30  )« 


Substituting  initial  conditions  ? 


>  IS  i  t-n  0  r-  ^4  Uf^G  O  C  . 

'3  J  r  ._*,u  d  *=  3t  4 

'5  P 


•y  •“*  co  8 
dn 


120a9  d  ‘.Jr  tiia  (I20a°) 


sc  that. 


Hero i  yg  «  «S5  y^  *  lf.  y^  2.  yR  «=  «t>f 
substitutions  in  th®  original  equation* 


3f  oto«.r  at.s  nm  bo  ohecfeed.  hy 


213©  equations  which  wo  mast  solve  ere  o.ura'l t mcoue  linear- 
difiOvonco  equations  with  constant  cooiflcleiivs.. 


-■  ■  :-i  i . i- ,  nil  I’tttlil  ttt 


Report  Koe  B-1X4 


y_  ~  0  •  ,hr  )  :«•  ,  +  hr  ., 

a  o  n  i  n~  i 


v  •--  (X  «■>  "~a£:  •)  v  ..  *»  hy  ., 
a  a  a  -1.  nv-J  • 


Writing  in  the  operational  form 


[_E  -  (1  -  )  J  y  h  T  a  0 

h  y  +  js  -  (3.  -  J£.  }j  '  y  «  0- 

a  J 


I'o  solve,  eliminate t  aayt  y. 


Adding 


(  [s  -  <J.  ~  .&  )] 

V»  «sl 


”  L 

—  ♦*>'TTrr 

•*> 

Kt 

„  hB  yl 

He*’  ■  | 

V  at:  0 

*i7  *' 

+  bsl  y 

«  0 

The  roots  are 


E  a  (1  -*.  ~Jil  ) 1  h  ss  r(eo  o  9  ;)•  i  sin  ©) 


where  r  --  jl  •>■  h ‘/ a  f  tail  © 


h . . 

1.  -  ha 

-  ;  ■' 


n  a 

Shua,  y  ~  a.  r  coa  n  9  +  r  sin  a  tt* 
21  c* 


2o  find  v  o  substitute  in  the  equation 
n 


yn+l  =  U  -  -|£  )  yn  +  h  »ns  or 


h  Tn  “  y«rtl  "  (1  *  -J’  }  V 

Since  h  ~  r  sin  ©,  1  -  **  r  cub  ©p  thJ.u  becomes 

3 

r  ala  9  v  =-  rtt+^  «.  (eoa  n  S  cos  ©  sin  a  9  sin  0)  -f 
n.  1 

J.1  r 

ra  '  o. .(sin  ft  ©  cos  ©  -’-  cos  a  ©  sin  ©)  ® 

i  ^  ' 

» 

.„,tt'f'‘X,  ,,  ___  n  C  —  v>U,J-!-.  nr'  i  £*  n?i  n  V'  Q 


r,tm  cos  ©  £5, cos  xl  ©  "»  r11'1’  oofi  ©  o,,  ala  n  9 

1  A' 


/...«iU.t-iul<  ,.  ,-,»i,i  'ou»wnWWWC!*iavra?*i"Wu^''-.:»«N  iiftertwaw  • 


. 'n*'M»*U!MXS,\ZSi 


11  ' "TTk 


T'T'sTff y* I •'TTVIVT  1[  TI  •"T'”T'*;  "u'”  ’ ^  T'r'Jiry 'rvf'j »»wnrm^ 


(TJJtVW  > 


*r 


f 
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,.  _  »n  00a  nQ  i  r  (!  co a  Q  -v  v  sin  ©  -  r  u,  cos  ©  ;  "*’ 

’*  'TaTaO°  t  1  *  -  > 


jn  sin  a  0  L.  v.  ei.ii  Q  +  :r  o^  00 *  ®  "•  '■•  Op  00  a  0  > 


r  ain  ©  f 
_  .j  oca  a  ©  **  r  Bin  £ 


Than, 


y  sa  l*U ( (J*  COB  II  6  r,0o  filO  U  G) 
tt  1  * 

t  =  r'(  j«  mb  a  0  *■■  0,  Bin  u  *5)« 
a  2  1 

Nowv  to  satiofy  the  initial  condition,  yfi  and  vy 


y0  “  Cl!  To  K  -a 


30  that  finally, 


y. 


a 


«  rn(;/o  cob  a  ©  *•-  e,  Bln  n  ©) 


v  a  rn(/  ci  b  n  Q  ■*  y  sin  n  S) 
n  o-o 


where , 


f  h4 

:  ,/l  +  J2L  end  tnn  ©  =:  ; 

V  4 


1  -  hi 

o 


v/ith  these  formulae,  it  1  n  poeal'lsle  to  analyze  the  long' bin-  1.0 - 
havior  of  the  numerical  solutions.  The  points  oil  U«  on  tho  curves 


Bin(u)t 

,pt 

1 

cc  o(i»t 

whore, 


a  »,/  y0a  +  »0*  .  9 


.  iss.i  , 

11 


n 


It  ie  wall  to  compare  the  approximations  found  with  the  true  solutions*  ^  W 

y  =  A'eia  (t d-ci) 

7  =:  A  cu  a  (t  *}  os) 


1  m  , .  -  #Jv.  1'  i,  Jlu.ii  n'i  ♦  x  /i-a  wi  i  ,  »  •-  A  'i Ij  .  •  .  n  I  • -»  1.  .  w  ,  \  ‘ 


i  il? 


i  j iii r  i II ^fUhlkbi  I fi 


■  v^- ;■ . -lf\  -T^:,:.s=  ■:  ?■ y^iiisiE ;"wy;« '■'} p 
1  :■  -  i!^!!?l  . . — r- -  -  i  t  in i  n  i miinpMum 


wher 


It  a an  be 
a  damped  sine  wave® 
r  is  lo s a  than  X, 
approximating  point. 


Other  Extrapolation  sad  Integration  Methods 


She  results  of  other  methods  of  extrapolation  and  integration 
ore  similar  to  throe  just  deocribod.  She  approximating  points  11©  on  curves 
which  have  the  fora 


where  the  values  of  [?,  mt.  and ^  are  functions  of  the  step  length  h®  Onj  of 
the  p«a  is  approximately  zero  while  the  rest  sere  large  end,  negative*  She 
beat  results  were  obtained  with  a  parabolic  axtrapolatloa  and  integration  \ 
using  two  points  and  one  slope..  ?Mti  resulted  is.  two  ,6 (| «  and  two  ur's,,  One 
p  wao  near  aero  with  the  corresponding  uj  very  near  to  one*  Hov  am all  value a 
of  h  tho  p  was  email  and  negative »  Iter  h  ®  ,1LC  twenty  points  per-  period,  on: 

l,f0  loss  In.  amplitude  per  period  was  observed®  Eor  va3.ua a  of  h  near  3t  howavc; 
the  p  had  a  positive  maximum  so  that  again  negative  damping  wac  introduced® 

In' fact*  in  any  numerical  method  of  the  type  under  ddccuoslo'n,  negative  damp¬ 
ing  1 3  inevitably  introduced”  for  valv.es  of  h  which  ere  large  enough® 

The  attached  figures- show  the  behavior  of  approximation  for  some 
of  the  methods  used®  Sheet  X  shows  the  numerical  solution  for  the  case  at  , 
two-point  one- slop®  parabolic  extrapolation  and  integration®  Thorn  are 
twenty  points  per  period®  Sheets  2  and  3  show  the  numerical  solution  for  the 
case  of  one-point ,  one- elope  linear  extrapolation 'and  Integration  for  two, 
four,  six,  eight,  and  ten  points  per  period., 


0®.  «  To  generalize  the  results  obtained, 
to  the  linear  vibration,  equation  with  damping. 


Xhs  result a  can  b«  summarised.  ar.  1'cj.1ow3 


1)  qualitative  character  of  damping  was  pro served*  ®ho 
only  method" used  vac  &hat  of  linear  one-point  one- slop  extrapolation 
asid  integration*  She  ‘numerical  solution  predicted,  ovordaxaping, 
critical  damping,  end  uaderdansping  correctly* 

3)  She  amount  of  damping  was  usually  too  small *  It  was 
*  nearly  correct  for  small  values  of  h,  hut  ae  h  increased  in  sis®*  the 
amount  of  damping  become  much  loss  than  'she  equation  required* 
f not,  for  h  equal  to  approximately  3,  the  negative  damping 
characteristic  of  ths  numerical  method  was  enough  to  cancel  all  ths 
damping  brought  in  by  the  equation  so  that  a  net  negative  damping,  was 

present*  .  . 

•  \ 

3)  i’h«  attached  figure  shows  the  apparent  damping  ratio  as 
a  function  of  number  of  point e  per  period  for  different  values  of  true 
damping  ratio*  It  should  be  noted  that  the  damping  ratio  always  becomes 
negative  for  less  than  three  points  por  period* 

«.  Another  generalisation  was  made  by  investigating  the  solution 
of  an  equation  with  two  natural  frequencies 


°°y  '!*  101  cy  +  100  y  «  0 

Aa  has  beon  snewn,  If  twenty  points  per  period  of  an  oscillation  are  taken, 
the  solution  io  wall  represented,  while  If  but,  two  points  P©r  period  are 
■SQlcnnr,  there  lo  bad  divergence*  Tho  two  natural  •period n  of  the  above  equation 
are  2tt  and  *2n,  so  that  when  h  =••  tin,  wo  have  twenty  point m  in  the  longer 
period  and  two  in  the  shorter*  Initial  conditions  were  selected  to  suppress 
the  higha?  frequency  compl ntoly»  Wton  the  numerical  solution  was  oarrlec. 
through,  it  was  found  that  the  higher  frequency  was  not  oppressed  and  the 
divergence  phenomenon  associated  with  two  point  spar  period  was  very  much  -r 
evidence*  It  appear,;  that  only  very  sped  til  initial  conditions  could  suppress 
the  rapid  divergence,, 

PART  II  i  -  Conclusion 

proa  what  has  beon  found  it  appear  a  tho$  indiscriminate  use  of 
numerical  methods  is  not  possible*  An  accurate  long-time  solution  cer  bu 
found  if  the  steps  crji  be  made  sufficiently  small  ,  or  what  is  some  tiling^ 
if  the  time  seals  ceu  be  expended  sufficiently*  fhe  preacnoe  oi  high  natural 
frequonciOB  produces  serious  distortion  if  unlimited  expnnolon  of  time-  is  not 
possible* 

It  fjhould  b«  mentioned  that  in  the  nouo  studied,  tho  exact  solution 
is  Jcnown  so  that  the  amount  by  which  the  numerical  solution  is  in  or  re s  t-oja 
bo  easily  seen*  lime,  there  Is  no  temptation  to  regard  a  given  numerical 


'i!he  study  nrado  here  lie. 3  fcekofl  no  account; 
statment  con  da  uade  c.n  to  the  effect  of  round-of:.' 
greater  for  smaller  time  divisiono.. 


Bugiaaer 
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COM PL. E.T E LY.  VERTICAl 


5H0WN 

POINTS 


WHEN  CURVED  ARE  NOT 
PLOTTING  OP  REMAINING 


INTERPOLATION  METHOD  USED 


EX  TRAPOL ATION  V U  NEAR>  USING 


1 1  POINT  AND  I  SLOPE, 


I  NT EGR  AT  <ONr-LVN  EARiJ-USiNS-T-PO\NT  AND  TSLGPE- 
INITIAL.  : CONDITIONS  •.  aL>*ol  !U*=:C  _ _ : _ ...... 

i  ‘  T  I  l  7  °  til  \ 


SOLUTIONS,  SEE  0-3ai7l-G 


"!m*<ft!T***r*V*-i* 
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“0:i  J  ,  W.  Forrester 

y-eon-j  %rre»  S„  Loud 

Subjects  Discussion  of  &uOTsrlcal  Metho&c 

Dates  March  17 t  194? 

t 

Digital  Computation  ami  Numerical  f-fethods  as  a  How  6*1© Id  of 

Mafihoraat  less 

tilth  th®  advent  of  high“apoed  digital,  computing:  isqulpment .  the  ztowA  for 
snore  study  of  numerical  methods  becomes  apparent •  Many  questions  of  a 
mathematical  nature  arise  when  an  attempt  is  Bad©  to  es/ploy  this  now 
machinery • 

'J'wo  main  aspects  of  tho  theory  present  themselves*  First  there  is  the* 
question  of  errors .  A  numerical  solution  of  an  analytic  problem  will  bo  in 
error  because  the  numerical  method  is  di norite  and  not  continuous,  'and  because 
any  numerical  expression  is  only  an  approximation  to  a  quantity  which  is  not 
rational  v/ith  a  small  denominator ..  1’hs  tw  kinds  of  errors  arc  called 
truncation  errors  and  round-off  errors  respectively-  I'h®  study  of  errors  in 
of  utmost  importance «  Mo  confidence  can  "bo  place  in  a  numerical  result  unlaso 
an  estimate  of  its  error  is  available  A  numerical'  solution  of  a  process  can 
be  badly  in  error  yet  no  clue  to  its  error  might  bo  in  evidence » 

A.  second  aspect  of  the  theory  is  the  question  of  numaxical  methods  used 
with  physical  problems  without  an  intervening  differential  equation*  It  would 
be  of  interost  to  know  just  how  numerical  methods  can  bo  used  directly  v/ith 


physical  or  engineering;  problems-. 


Ideas  for  &  Oourne  in  Stunts? leal  ifctho&s 

I ,  Background 

At  first  sight  rmifler leal  mtho&e  appear  to  1ms  merely  a  toe?,  for.  irndwr-’ 
standing  and  treatmant  of  mothauatlcal  subject  a .  ®.hio  Lb  not  entirely  true* 
for  numerical  computation  and  it  a  aocorspanyl  ng  problem©  form  a  proper  field 
ief  i pure  mathematics.  Indeed  one  can  look  at  the  problem  frost  two  points  oi 
view,  that  of  ucihg  numerical  method©  to  l«ara  wore  about  other  fields  oi 


mathematics  or  that  of  using  the  other  fields  of  mathematics  to  learn.  mar® 
about  numerical!  methods.  However;,  since  numerical  methods  do  have  mush 
application  to  other  branch© a  of  mathematics  and  also  to  engineering*  it  i® 
advisable  to  obtain  as  broad  a  background  as  possible  in  the  application  of 
numerical  methods  to  the sa  other  fioldo.  Shore  is  a  three ~£q id  objectives 


her®..  First*  It  ia  wolf  to  know  the  material  so  that  places  where  nttnardcni 


Methods  arts  of  use  at  present  can  be  known..  Second p  a  wid©  acqua In tanoo 


with  related  fields*  is  desirable  if  new  results  within  'the  12  as*©  to  bo  iound 
by  numerical  methods o  Shird *  it  ia  well  to  have  as  wnyxj  tools  as  pcoeibls 
for  advancing  the  art  of  computational  method®.. 


LIn  Specific  i'oploa 

Mathematical  field a  which  would  bo  studied  include; 

A»  Algebraic  and  transcendental  equation©. 

B.  Differential  Equations  both  ordinary  and  partial. 
0.  Integral  Equations. 


P„  General  Computations 


MM PKP11  Ill 

^!Pplfj|||i!l 


iMjMiitfB 
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Biso>"  rfflica 

A.  Under  algebraic  equations  w®  might  omphasUn  the  field,  of  »l3uU&'.tacn« 
linear  squat  lone  in  large  mffitoo  of  unhnownc*-  la  general,  iterative 
procedure o  should  he  eutphaslzod  in  ^hls  s  ie;.d  In  vie-*'  of  •'ho  .na^tu-i 

of  hlgh-espood  computers  currently  being  d-s  vet.1',  oped. 

B,  Ordinary  Differential  Equations 

Burner leal  methods  to  date  have  not  bom  helpful  ia» the  theory  of 
differential  equationo  because  the  tiera  involved  to  obtain  cu..l  Icceut 
information  to  generalise  from  particular  solutions  has  bean  prohibitive 
With  the  now  machines  it  ie  to  be  anticipated  that  sufficient 
particular  information  can  be  gathered  in  a  reasioaablo  tins  no  that 
generalisations  can  bo  drawn.  ‘fhitf  can  bo  considered  a  reason,  f  • 
study  of  this  field  aver  and  above  the  doci.ro  to  salvo  equations 
vrhich  cannot  be  solved  in  terms  of  elementary  function*. 

Partial  Differential  liquations 

She  statement o  made  under  ordinary  differential  equations  app^y  . 
hero  but  with  more  force .  Partial  differential  aquations  aro  nor* 
difficult  to  solve  „  Haver  the  lo  sa  many  physical  problems  or®  currently 
phrased  in  tanas  of  partial  differential  equations.  Also  since  Vm 
theory  is  bo  much  nor©  limited*  it  will  *©  important  to  have  means 
for  gaining  new  knowledge ..- 

\ 

0 «  Integral  Equat ions 

Integral  equations  have  been  used  more  in  recent  year®  in  physical 
problems.  It  would  seem  tlmt.  hero  is  a  place  waere  numerical 
methods  could  b©  widely  uaQ&-> 


motsm 


•.  v  J 


femorauiduEi  So «.  **”63. 


Korah.  17 1  W4V 


X)  .  tiunaral  OomputJAtlong 

Shores  nr®  problems  in  existence  today  which  do  not  yield  to 

naaiytical  solution-  1  Such  problems  aria®  in  tit®  theory  of  fic< sign 
of  optical  systems-  Sumsrical  methods  are  absc-lutoly  necessary  In 

/ 

ouch  problems-  la  addition  matrix  calculations  can.  be  studied  from 
the  point  of  view  of  hij$$- speed  machines* 

XU.  „  Mathematical  Methods  Wood 
A.  Eolaacatlon  Methods 
B  Iteration  Methods 
0-  General  Ifcwrioal  Methods 

Rolax&tioname thoda  are  a  recently  developed  tool  finding  much  as® 
in  numerical  worlc  with  engineering  problems- 

Interation  procedures  aro  given  a  special  place  bacons®  it  Appears 
that  they  will  bo  of  highest  importance  with  high-speed  maohiaoc» 
'■they  represent  an  essentially  simple  process  repeated  many  tiaiast- 

An  addition  general  numerical  method®  as  described  in  books  J.llcs 
fioarborough  would  bo  considered o 

Under  numerical  methods  in  general. »  two  remarfij  should  b®  U8«®» 
i’irot „  there  needs  to  b®  as.  assembly  of  pertini-nt  Material-  Much 
valuable  literature  on  the  subject  is  not  collected  in  books,,  and 
it,  is  often  not  available  in  English,  Second,,  mimrioal  methods 
should  bo  examined  with  the  thought  in  mind  that  they  are  to  b® 
tua©d  with  high- spaed  machines-  IYs sent  —day  methods  arc  designed 
for  deck  calculator  speeds  or  slower*  ‘As  a  consequence,;  they  Airs 
complicated,  calling  for  reasoning  and  judgment  on  the  part  of  tho 
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operator .  1’or  high-speed  roach  .taes*  rjinplm."  repetitive  a®th«< 
should  b©  considered*  She  high-sp-sofle  permit  ;io  ras-ny  stops  to  b<,v 

r 

taten  that  th«  accuracy  As  still  increased 
IV  r,  Errbra 

r 

Homerlcal  methods  introduce  orrcrs*  Such  errors  are  iitportant,  since 
:l v  io  neeassary  to  know  how  close  to  %'m  tree  solution  n  numerical  solution 
lies-  5?hey  fall  in  general  into  two  classes,.  truncation  error®  nnd 
round- off  errors  3?runoatiori  errors  are  those  duo  to  the  fact  that  n, 
numerical  prone  an  :la  different  from  an  analytical  proouatu  Such,  error  a 
can  bo  studied  by  analytical  mat  hod  a-.  Round-aff  errors  evra  due  bo  the 
necessary  rounding  off  of  -each,  numerical  step.  Shis  Introduces  errors 

which  are  of  a  random  aaturo  and  difficult  to  analyst)-, 

* 

Sew  Mathematical  Results .which  can  be  Obtained 
by  Numerical  Methods 

At  the  present  time  it  is  difficult  to  state  Just  vrhat  mw  mathematical ' 
results  can  be  obtained  with  high-speed  machines*  An  opportunity  for 
mathensatlcal  experiment  presents  itself  She  technique  of  gwius'r&liasatloaa 
from  particular  sapor  Amenta!  re suit  a  so  long  used  in  science  can  bo  greatly 
extended  la  mathematics  Much  work  of  this  naturo  ought  to  bo  done-.. 

As  an  example  of  results  which  can  bo  obtained  the  theory  of  partial 
differential  equations  la  in  need  of  particular  results  that  mor®  generaliaation© 
may  be  drawn  Shore  will  also  be  an  opportunity  to  atudy  leng-tim*  iteration 
procedures  in  general*  'iteration  procedures  haw  not  been  studied  much  in 
the  past  because  they  converge  slowly  if  at  all-  However  with  high-speed 
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Baohinoa  'fha  slowness  of  convergence  le  ao 


of  tvrpo: 


of  such  procedures  can  bo  studied 


Many  tfeooroms  in  mathematics 'sre  of  such.  a  gcaei'al  Batura  that  thsfs  vtso 


in  specific  oaooa  la  not  possible 


With  machines  of  the  type  considered  iaor© 


concrete  information  can  b®  obtained  from  those  general  theorems For  aanmplo 


an  exist® no©  theoreaa  In, order  to  b®  general  often  giwu  too  restricted  a 


result ..  H  should  b®  possible  to  obtain  astir®  cozstpreh*nt!ilv«  results  in 


particular  eases  with  such  methods 


;ok  1 1 
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Dl3cu.33l.ou  of  Determinants  of  Large  Order 
1)7"  Profssuor  ITor  lort  Wiener 


SUBJECT 


DATE! 


Computation  of  determinants  of  high  order  involve*  problem* 
which  do  no  v  appear  for  low  oirdoro.  Tho  error  prose  at  in  the 'terms  1b 
olwoyo  multiplied  by  a  factor  proportional  tc  tho  square  root  of  the  order 
TMo  result  a  In  the  situation  that  for  large  determinants,  If  the  terns 
are  not  known  accurately,  the  value  found,  la  quite  meaningless,.  Standard, 
computation  methods  Introduce  more  error  than  the  above  Inevitable  error 
boo  allot1  of  subtractions  of  large  number s» 

Professor  V/lanor  gave  a  description  of  those  two  errors,  the 
unavoidable  and  the  avoidable,  with  suggestions  for  reducing  the  latter „ 

He  then  proceeded  to  discus 3  places  In  mathematics  where  determinants  are 
Important,  in  particular,  integral  equations.,  1 


Lot  the  elements  of  a  random  determinant  bo  a,  . <•  i, ,j  "  1,3,.., 

of  each  element  be  zero,  end  let  the  r.auBo  of  oacn  element  bo 
une  the  elements  are  completely  Independent. 

% 

Then,  if  D  i.3  tho  determinant  of  the  a^,  D 3  la  corapoviod  of  ni 
iw«o  n«>h  r>* F  which  has  a  hq er1.  of  •  and  oho  OX'OS*  wo,®?.  oi. 


II „  Sffoc t  of  Srrqra  la  the  Terris 

Suppose  there  U  sai  error  b^  in  each  term  where  the  1^‘tt  have 
moan  &sro,  r.m„a»  b,  and  aro  independent  of  each  other  nnd  of  the  '.jjc-  We 
boq'c  the  r.a.iio  erroi*. 

If  D“  is  the  determinant  of  a,  .  +  b  ..  the  above  3 eye  the 
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How  3J  -  B  contains  all  the  terms  of  J)r  which  have  at  least  oa 
b  la  them,  Therefore  (D6  -  B)3.  contains  all  the  square  of  these  terms  plus 

terms  of  aero  moaa«  The  moan  of  (B4  ®  B^a.  will  ha  ^(aa  'r' t3)  '"’  a*"  -J  n" 

c%t* |  yi"-nr,*~>'t''Jgm,'u>l3~;^;iI^'l:i::l^JCI,:Lj* 

and  the.  r»m.  s«  of  B8  «'  D  will  he  <%n;!  v  (av  +  b*',.  *>  .a 

The  relative  error  is  — . — 

r:  /rzr-TZF~~M  '  (  V  , 


Jnl  \/{  aa  +  bs) 


vni  a 

III,  Large  at  Tolerable  Error  in  a,^ 

An  error  in  a  determinant  of  over  100$  is  intolerable »  Sine©  an 
important  property  of  a  determinant  is  it  a  being  different  from  aero  or  being 
aero,  a  100$  error  introduces  uncertainty  hero  and  is  intolerable,  -herelorc, 

we  must  have 


1  <C  1 


•h3  3 


a  S  -  1 


How,  if  ,  1=  large.  8  1  -1  -  H* 

so,,  2!  <  iaa^  U4  4^  /SET  *  -21  * 

aa  a.  I  a!  n  J 


,8  S3  0 


ssarjElSWrmsacriffiliwo* 

II  /  -  n  f 

Conversely,  If  U4  =  «.  «»  roloUvo  error  is  */  (1  +  *2>  -  1  =  « 

I  Gl  i) 

approximately,  30  that  all  errors  In  terms  are  multiplied  by  /  n. 

If  n  —  100,  we  must  have  terms  to  within  ,083  and  smali,  errors  aro 
multiplied  approximately  by  10, 


s(jn  s 


ilv 


it>  .>.i.uaatA.,.-«U.Jw.fe«ii.y,  ,  ;r  -  , j-'  iiJtfcjiiiir  r  i  ■  •  ’-rL  -  '.fV.^i.  -/  .  J-.:-  '.  ;>  v.  j.’l'i  .  ■••<•■  ..A'ibfe.b,  •-.:  - . ..»,...■  ■  ■■  x . ' . .-- . -•»:,■  „i., ,i£ii 
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IY»  Discussion  of  Metko&c  of  ISvaluntion 


.  If  a  determinant  is  evaluated  by  evaluating  tile  ni  terms „  wo  find 
we  obtain  numbers  of  the  order  of  vf  rTf  a11  by  rrubtro acting  numbers  of  tho  order 


of  aUo  If  a  is  largo,  this  1b  very  wasteful  of  significant  figures 

3 

and  may  destroy  all  of  them* 


For  large  determinants  it  is  better  to  obtain  relatively  snail 
numbers  by  multiplying  rather  than  subtracting,,  The  method  Wiener  suggested 
Is  tho  following: 


lo  Divide  tho  determinant  row  by  row  by  the  mein^di agonal  element  s,, 
res&ucing  them  all  to  unity-  She  determinant  so  obtained 


is  multiplied  by 


1  D  D  IW 

a, 

.in 

• 

0^1  O  *  ft 

®2n 

o  o  o 

anl  an8  * °  “ 

1 

X  £t| g  o  »>  o 

"*%n 

'”^'^1  °  *  ° 

™c,a2n 

a'sanl  ~enn2 


The  resulting  determinant  is  treated  tho  same  way,  and  the  process  is 
iterated  until  the  resulting  determinants  are  as  close  as  desired  to  the 
identity.  If  e  is  taken  too  large,  the  process  will  not  converge,  If  e 
is  taken  too  small*  the  process  will  converge  very  slowly. 


(The.  above  procoon  was  tried  for  second^ordsr  determinants®  It 
can  diverge  badly,  and  moreover  although,  for  suitable  e  it  will  converge, 
it  can  converge  to  a  value  more  than  100$  off, ) 


Professor  Wiener  wont  on  to  remark  that  we  might  as  well  study- 
determinant  e  which  differed  but  little  from  the  identity. 


f 

I 


1 


1 


■  i'Sll 


rtSrfyMtttiiikii  i^wii 
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Jo  find  D  «  3  4-2j  V  _  + 


1 

\x 

*1 2 

*  •  n 

b„  j 

OP  1 

l 

j 

*23 

1 

'y22 

IBP 

h*  1 

V 

•  • 

A 

°n2 

.  0  «  1 

,  +  b 

nn  ; 

1 

J, 

21 

{**>» 

$ 

I  b 

b 

-  L 

|  nun 

•IU< 

. 

!  a 

b 

1 

an 

•; ha  mean  oi  *■  j. «*  *  -»■  ^  2?  ’  3J 

If  ub2  =:  1„  D2sl*hl-J-(l. — and  io  nearly  n« 

If  11^=  k,  with  k<l  and  neglect ing  l  £  oo0  spared  to  1, 

n  n 

D2<:i+]£f'c2+  ...  k“ 


t  r.*  1.  X  +  nb3  +  afeii  .  as  **  +  3!  bs  ♦  ... 


r"~i~  wkich  e<iuals  2  when  kr=Tf. 


fhuB  h  ~_~i—  or  „l£_  gives  an  error  less  than  100$ 

VS  VS* 

but  b  zzz3 —  gives  an  error  greater  than  100$, 

Vn 

For  some  a,.  C.7<^<!»  b  =  _iL_  gives  an  error  of  100$ 

VT  * 

Tho  solution  of  1 inoar  algebraic  equations  can  ho  effected  without 
the  use  of  dotermiaants,  since  there  exist  other  methods  which  involve  less 
confutation  and  lose  chance  for  error. 

Tho  Fredholm  theory  of  integral  equations  does  Involve  determinant 
-jp.d  thin  la  a.  piece  where' numerical,  methods  with  determinants  definitely 
have  n  place 


V/SL/has 
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Sho  following  Ira  a  report  of  'oh©  discussion  given  on  May  13, 
194?,  d;/  Professor  Wiener  for  the  repro oeat  ntivao  of  the  Departments  of 
Electrical  Engineering  and  Mathematics* 

When  a  numerical  procane  is  used,  "obvious15  methods  of 
setting  up  a  numerical  problem  often  introduce  excessive  error,  Let  us 
consider  the  problem  of  finding  the  derivative  of  an  cpproximated  function* 

A  process  that  gives  an  exact  derivative  is  very  undesirable.  If  a  function 
is  approximated  to  a  finite  number  of  decimal  places,  the  approximation  is 
a  step™ function,  whose  derivative  in  zero  or  infinite  at  all  points,  co  that 
the  Qjcact  derivative  of  the  approximation  1g  of  no  veins  at  silo 

Let  uo  try  to  find  a  process  which  will  find,  the  derivative 
of  f(t)  with  the  least  error  in  the  mosaic  square  sense «  Given  en  sppro;d,~ 
mation  to  f(t),  f(t)  +  g(t),  where  g(t)  is  the  error,  wa  seels  an  operation 
on  f  -t  g  which  will  give  f“(t)  with  leant  mean- square  error.  Wo  seek  aa 
operator  K(t)  such  that 


K(t  .•=  v)  f(r)  >fr  g(r)  d-r 


is  approximately  f"(t}0  Precisely  wo  so  oh  K(t)  such  that  the  moan  with 
respect  to  t  of 


K(t  «  t)  £(t)  +  g  (t  )  dr  -  f:'(t) 

t\  ** 


is  a  minimum,  The  moan  with  respect  to  t  of  a  function  f(t)  is  defined  as 


63*;  S 

Keirory  idnia  No  „  H»78  .  Bevluion  1 


Urn 

'i’-fc  co 


r 

_X,  }  f(b)  dt»  Wo  abbreviate  thi n  or,  M  f(t}« 

!5 


The  sxrrooaion  bo  he  minimi  vied  ?.ti 


M  /'  /■  5  ;c(t ..  t)  ’"f(-r)  +  gWl  K<4  -  <’>  |  rt  cr)  <r  )  ]  a-s  A<r 

t  i  J  L  J 

d  /Vt  -  t)  ff(T)  +  e(T)  j  f’  (t)  C.1  +  y.  jjT‘  (t)  „ 

\  /  rrrfc  L- 


OQ  ^ 

ad  /”  i 

4  cro 


To  sillily  the  aho7<  we  not  1  name  knowledge  o2  f(t)  sect  g;\t)„ 
;hat  ws  know  the  auto-  corxolj  sione  oaf  ™(t)  rand  s(t,  and  alio?. <■ 


Let  ua  actaume  that  ws  know  the  aato-oorTol 
cross  correlation*  Chsso  are  reepe  :tiva.Ly 


It  ) 

=  H 
t 

[f(t  -V  V  )  1  t)j 

^22 

(t) 

=  M 
t 

[g(t  +  ?}  :(i)  1 

Pi* 

(t) 

=  M 
t 

[f(t  +  t)  5  t)J 

Let  ua  first  make  tha  ctmuge  of  variable  t-  •  7  «  ^  t  -  T  f  c). 
The  espremaion  to  ba  minimized  become* 


M  r  (-■. kc^)  x(cr1)  C-m  -  v  +  s(t  -  .  ii  C*(t  -  i7i]  *  g(t  -  °V-J  d,x Ac 

t  /'  4  _2 

-,2K  [>U  -  V  +  BU  -  ^fj  ^  +  K  [f’(t)l 

,  fv«w  *(«•)  [>u  <ff  -  T)  +  ^  (cr-  )  *  ^  »<r)  i  ^*(ff-  -r)]  *>» 

‘‘*0  —  f*  *1* 

.2  /•*(T)j^u’  (t)  +  ^2‘  (t)J  dT  +  Mif’  )*>J 

■„,hero  *?,  aad  cr.  have  been  wilttan  aa  t  au<>.  Cf  »  . otlag  ‘>hat  uiv;  to;.ra 
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is  jLttdepe1xd0n.il  of  E,  w e  valise 


r/&  r-  j)  «  “"I 

K(<r)  K(<S  )  P  (  &  -  t)  drrdCT  «  3  J  K(t)  01]l  (t)  +  p12  (■'  )  At 

•  o  '  o 


to  1)0  wiaiialssdo 


So  do  this,  we  writ©  K -!-  eC-cT  K)  in  place  of  E«  She  resulting 
expression  should  ho  minima  for  «  «  o  ao  matter  what  K  :U„  • 


o  •**  o 


=  /®  |\(T)  ,y  CJ  K(^jj  j  E(q-)  +  j  J  E(cr)j  0  (O'-  *0  dr  A cf 

“*0  -O  _  !  n 

-  3  f*  &T )  +  c  d  E(t  )|  |™  j&31  (t  )  +  P12  d  )|  dr 

y0  ~ 

««  =  /  /  |i{(t)  /  K(©*)  +  3f.(0>“)  <gjf  S(t)  +  So  olT  K(t  )  cf  E(<X )”]  0(8  &(S  d'i 

E  **0  ^  0 

'  -  2  fdK<7)  jj'n  )  +  Pi3  <'T  'J  dT 


For  s  *  o,  this  is 


/'<33 

*  ■  |  '  3K(cr)0  K(t)  0  (or-  r)  dCTdT  - 


0  0 


'7  Kir)  I  pn  (T)  +  ^2(r)b 


dr  -w  0 


since  0  (©*-.  t)  3  0  (t  -  <jr)o  Shat  A  a,. 

2j^rK(r)  |  (^\{&)  pi  (Or  -  t)  dff=  0^  (t)  -  0^  <*0  | 

for  all  possible  <jf  JE(t)*‘  This  is  possible  only  if 


J®“k(CP)  0  (  @  ~  r )  (Iff  a  0U  (t)  +  0^  (t) 

which  la  an  integral,  equation  which  K  must  satisfy  for  t  ^  00 

To  solve  the  Integral  equation,  take  Fourier  Transforms, 
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•  TTH»r ’ ^TPP-,wr"!'W'"WT^r.'  PW.X* 


4 


K  (<r)  0-(ct«t)  do*  =■  fh .,  (t)  -  j f)^0  (t)  (  o'"'4*"  &  r 


■CO  (  *t) 


J 


Sine®  tha  expression  in  braces  is  sere  for  ?  >  o,  ‘Six®  transform  in  of  ths 
form 


0(t)  t*  d  v 


-03 


and  so  is  bounded  for  Im  m  >o„ 

We  manipulate  tie  transform1  further  and  obtain 


/  co  _  da 


K(er )  p  (t-ct)  GraitMCr  e"1®*T“cf>  dcra 


’O  >  “  09 

* 

aliico  0  (t  =>0’)  ~  P  ('O'”  t), 


[\i  (T)  "  ^12 


('?)  e 


.  OB 


K(cr)  e^^^dcr  P  (t  ) e“iu/r  dr  -  J  |^31  (?)  +  01S  (rj|  e  il'"” 


a 


-  03 


CO 


where  t  ~  G  has  been  replaced  by  t  in  the  T  integral* 


Row  write 


; 


oo 


K(«r)o“:tw<r  do*  as  1c(jj)  . 


J 


ac 


J#(t  dV  =  f)  (os) 


~  OO 

CO  r„ 


(  [  $11  <’T>  +^12  (<T)1 
>  iw 

* 


e~iw'r  d  t  = 


=  H(c») 


>  CO 


We  note  that  k(oi)  is  bounded  for  X.m  «j  <  o„ 
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kum®®  4  (to)  is  a  rational  function*  Separate  It  into  two  factor;*  ’L  (©) 

j.  i 

and  f0(»»)  which  are  fro  a  from  zero  a  and  poles  in  the  lower  and  unper  half 
plane  s  re  gp©etively0 


We  thus  have, 

k(co)  (p  (ca)  -  H  (ui)  bounded  for  Ija  u>  >■  o 

k(to)  W,  (id)  ®  -S-lsiL.  hounded  for  in  <»;•  o 
1  f2  Vm) 

sine©  W0  has  no  saros  for  Ira  o  3>  o. 


How,  if 


;(t) 


1 

2n 


H(cj) 


'0» 


*2  (®) 


*Va  co 

,T)S"taT  dT 


MfciL.  '  dp,, 

*2  (i-0 


=  /  c(t 

CO 

»  A(oo)  *5“  B  (<o }  say. 


«(»)?"*“  dT  +  /  C(T)e"”r  d 

A 


i-"1*  **I?C5 


&3> 


k(«s)  {(/.i)  ■»  A  (ca)  B  (©)  j.a  hounded  for  I  a  a  >  o 


But,  A(ii>)  is  hounded  for  Im  m  o 


therefore,  k(«j)  (<o)  «  B(«?)  i®  hounded  for  Xm  ©  >•  o« 


Bat, 


k(ta.),  ISL'(cn),  and  B(«i)  are  all  hounded  for  Ira  ©  -to, 


.therefore  fc(uj)  Wj  («»)  •»  B(<b)  is  hounded  f o r  all  «•  and  so  is  a  constant 
which  may  he  taken  as  asroo 
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tooraad-Kis  ©>r. 


Fieri  gioa 


-t 

US1!U  t 


"iTH ST 

Jll 


b(o5 


7j  to)’ 


f 


-  t.'» 


i 

*’;>b 


c>/<  h 


j.’j )'{ 


dv 


1  f  •  i 

«.  ?  J  ,.«w 

J  J  Z(i 


Jli^L  O^'  .r1W  t!}l;  dT 

'Fp  (p.> 


I  ’  ^ j  •}  ('T  K  ■- ’iy.Cf  a?jA'r 


2-t  SL  (w) 


Tg  0*) 


e  a^dj-v.  w 


la  conclusion  wo  monticm  certain  changes  that  Bay  occur  i»  non™ 
linear  eases*  Message  end  no?.r»  any  no  longer  "fee  additive.  She  ha  at 
approximation  may  no  longer  ho  moanr-sq.ne-a'Oo  V?®  should  try  to  ueo  only  the  pa-st 
of  the  messages*  For  almost  all  oases,  the  future  da stri'bwt  icm  o;?»  he 
attained,,  Finally,  we  emphaoi se  that  the  original  ecit-np  of  a  pro'oUa  vriXl 
not  always  h©  the  proper  oeV-up  for  mlaiaaaa  error* 


Wa 'amm, 

Warren  So  XiOUd 


Iiild>wriN'ilri(«n<ir<Ii|hl 


0  ® 


Prof*  W* 

»  Po 

»  Ho 

!i  Go 

it  p 

■3A  p 

II  'f- 


So  Martin 
IVanfclln 
vtallsiaa 
3*  IhOBSS 
Saylor 
Wo  loo 


V/SL;  has 


^tces-'s  •  ns- ' 


ftvrrvw 
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Servomechanisms  Labors t ory 
Massachusetts  Institute  of  Technology 
Cambridge  „  Msssechuse tie 


TO;  J„  W.  Forrester,  Robert  R,  Everett,  634b 

Professor  Franklin 

FROM;  W.  S.  Loud  Page  1  of 

SUBJECT;  Suggestions  for  Further  Work 
DATES  August  6,  1947 


There  are  severe!  directions  in  which  1  feel 
that  me theme tlcrl  reaeerch  in  connection  with  the  pro¬ 
ject  might  well  be  carried  forward.  I  am  sure  that 
Professor  Franklin,  with  his  wider  experience  will  be 
able  to  select  those  which  are  of  value.  I  might  make 
the  suggestion  th»t  people. of  Mr.  Reich’s  caliber  be 
given  their  own  head  for  a  while,  I  think  they  will 
find  important  subjects  for 'Investigation  given  the 
freedom  of  lnveatiga tlon, 

I  have  some  remarks  to  make  about  specific 
topics.  They  are  of  necessity  Incomplete,  The  work 
already  done  Is  in  my  notebooks  and  Kiss  Florencourt 
will  know  about  it, 

I.  The  constant  energy  method  for  solving  differential 
eauptlons. 

4 

We  did  ouite  p  bit  of  work  on  this  Investiga¬ 
tion.  Precise  fluanti  tetive  results  were  not  obtained 
owing  to  the  mathematical  complexity  involved.  I  think 
the  Idea  will  be  of  value  in  physical  problems  because 
it  takes  into  account  such  an  important  physical  fact. 
It  is  particularly  of  value  in  non^dissipatlve  systems. 

The  principal  advantage  of  the  method  seems 
to  be  that  it  does  not  Introduce  bad  amplitude  distor¬ 
tion,  The  method  of  polynomial  extrapolation  and  in¬ 
tegration  Inevitably  Introduces  this.  The  frenuency 
and  phase  distortions  are  no  worse  than  the  other 
method.  Also  It  Is  a  relatively  simple  procedure  from 
the  point  of  vlew^fiet-up,  at  least. for  a  small  number 
of  carnations.  It  may  becoi/.e  too  cumbersome  for  the 
entire  A3CA  problem. 

Under  dlsadv^nt* ges  I  could  list  first  of  all 
the  fact -that  souare  roots  have  to  be  taken  and  some 
criterion  for  the  proper  algebraic  sign  selected.  This 
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raigiit;  involve  considerable  difficulty.  Mr.  Reich  has 
some  ideps  which  may  help  on  this  score.  The  method  of 
energies  although  reasonably  simple  may  turn  out  to  be 
too  complex  for  complicated  problems.  The  Question  of 
damped  vibrations  is  one  that  has  not  been  touched  on. 

I  have' no  knowledge  of  how  the  method  could  be  applied 
there. 

XX  Algebraic  Eouatlone 

Some  work  was  done  on  the  subject  of  algebraic 
equations.  For  the  case  of  simultaneous  linear  eouptlons 
I  expect  that  the  work  don©  at  Princeton  lo  better  than 
could  be  done  here.  I  think  that  attack  on  other  problems B 
using  their  results  as  much  gs  possible  would  be  the  beat 
plan. 

The  next  most  complicated  problem  Is  that  of 
simultaneous  Quadratic  adaptions.  The  literature  doee 
contain  much  information  on  number  of  real  roots  etc., 
but  complete  analysis  of  susceptibility  to  numerical 
solution  does  not  s@©m  to  have  been  carried  through-. 

We  have  done  some  work  on  Iterative  procedures,  and  tJa® 
results  are  mathematically  interesting  though  they  do 
not  promise  much  for  machine  computation  as  yet.  X  b©~ 
leive  that  statistician®  are  investigating  this  subject 
and  may  have  aem©  useful  results.  Methods  other  than 
iterative  might  also  foe  studied  In  these  oases. 

XXX  Error  Analysis 

The  knowledge  of  error  occurring  in  the 
numerical  solution  of  s  differential  ©auatlon  is  very 
Important  as  we  well  know.  Acting  on  Dr.  Golds tine 5 0 
suggestion  we  carried  through  an  analysis  of  error 
based  on  known  results  from  the  theory  of  differential 
eauatlons.  The  results  are  only  of  academic  interest. 

The  generality  of  application  of  the  theorems  makes 
them  very  orude  of  necessity.  X  think  investigation 
here  shou3.d  go  forward  in  , two  directions.  First  the 
analysis  for  error  should  be  specialised.  Sharper- re¬ 
sults  with  more  restrictions  on  the  differential  eo na¬ 
tions  to  which  they  apply  should  be  obtained.  This 
idea  is  contrary  to  the  current  mathematical  fashion  of 
generalizations s  but  I  believe  it  should  be  don®.  Second 
the  subject  of  round-off  error  should  be  treated.  I  agree 
with  Wiener  that  ..this oust  be  handled  statistically.  X  am 
not  too  sure  that  his  predictions theory  can  be  used  with¬ 
out  some  essential  modification,  but  I  don't  know.  For 
more  remarks  on  this  see  the  accompanying  report  on  my 
investigation  of  Wiener® 8  ideas. 
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In  general  I  think  it  would  be  a  good  idea  if 
the  philosophy  of  high-speed  computers  were  kept  in  mind 
during  mathematical  Investigations,  This  will  have  the 
affect  of  keeping  to  fairly  concrete  cases  so  that  the 
results  will  not  be  overly  abstract,,  and  should  also 
provide  the  proper  motivations  for  work. 

In  conclusion  I  can  say  that  aiy  future  xiark 
will  deal  for  a  time  with  these  same  subjects,  I  can 
let  you  know  If  1  arrive  at  results  which  will  be  useful. 


WftAAJMfV  S-  L  fvui 


WT  S0  Loud 


Servomechanisms  Laboratory 
MafsaachUfcotts  Inati  lute  of  Technology 
Cambridge,  Massachusetts 


TOs  Jo  We  ForreBter,  R,  H0  Everett 

Professor  Frank']. la 

PROMs  ■  Wo  So  Loud 

SUBJECT*  Report  on  Wiener” s  Ideas 

DATS?  August  11  o  194? 
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For  the  past  three  months  my  efforts  have  been  turned 
quite  completely  to  obtaining  something  concrete)  out  of  Prof,  V/iensr6  o 
ideas,  The  following  is  a  report  on  what  l  havo  learned  from  this 
study  with  what  conclusions  1  h are  Mm  able  to  draw, 

lo  The  Mathematical  I  do  so  and  Their  Scope  of  Application 

Prof  os  go  r  Wiener  has  developed  a  statistical  prediction 
theory  built  on  Fourier  Transforms.*  Ho  has  applied  this  thoory  to 
problems  of  filtering,  differentiating,  etc*  Hie  most  complete 
results  care  in  a  linear  theory,  He  hap  given  an  indication  of  a 
aon-llnenr  theory,  but  2  cannot  report  on  that  because  I  do  not 
under at and  it  as  yet 0 

» 

The  essential  mathematical  quantities  and  processes  vised 
are  the  auto-corralation  and  oross'-Qorrolati.on  of  functions  and  tho 
operation  of  Fourier  Transform,,  For  example,  let  f(t)  bo  a  function 
of  time.  Let  us  consider  the  case  of.  discrete  times  since  this  is 
raoet  applicable  for  digital  computation,  Vfe  wish,  to  find  a  formula 
for  f(t+h)  in  terms  of  f(t),  fCt-h),  f(t~2h),  „ Via  assume  a  linear 
formula 


f(t-t-h)  a 


<5® 

V* 

<Lj 

B~-0 


a,  fCt-nii) . 


and  we  seek  the  coefficients  a  eo  that  tho  maan* square  error  is  a 
minimum.  It  turns  out  that  the  beet  coefficients  are  tho  Fourier 
coefficient b  of  a  function 


k(u>)  *= 


<S@ 


fi.J  V) 


xdLj)  °ne 

!DP=C 

Wo  can  obtain  k(u>)  In  terms  of  tho  luto-corrolation  of  f(t)t 


4  peg OB 


Memorandimi  K— 9  b 


Definitional 


a  .  y  -5 

Yn  K->00 


.  >r 
K  -  -I 


$w  =  2  tf1* 

“*  n  =  -  e© 


f(t-HOrhih)  f(t+Kh) 


¥(uj)  is  a  function  each  that 


(a)  V(o») 


(h)  ?((»)  has  neither  poles  nor  aorofl  for  Ira  to  >0„ 


Then. 


k(to)  “  - — =jL-~.  j  0‘^nu 

3n  ?(m)  “^7:  o 


v/(n)©~i(n-a)u  du 


Wo  find  an  by 


Bn 


k(as)o  ck» 


If  wo  wished,  f(t+Xh)  where  h  is  an  integer,  the  corresponding  k(a>) 
would  he  ©«.  rtr 

i.  '*>  ,  e1"  JW?*1*11  du 

error  fsi  J 


Other  problems  that  can  ho  solved  arc  differentiation ^aad  filtering 
The  cacio  of  differentiation  I3  covered  in  Memorandum  M--V8  for  the 
continuous  cassSo  for  the  discrete  case  where  wo  would  vj1o,o. 


«5du 

Q  -sr**  ’ 

f  (t)  j=  a  f(t  -  nh)r, 

R  il 

JX^O 

,  /  x  inm 

k(<M>  ®  a^e 


would  ho  given  by 


d!  SicsiaeqBJtt * 

n  w  0 
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It  iii  asauiusd  in  ell  of  the  bo  formulas  that  there  la 
©siough  statistical  information  about  the  function  f(t)  m  that 

|(b),  which  dopeuda  oa  tha  future  of  f  aa  veil  as  it  a  past,  iu 
known* 

He  Limitations  oa  Application 

'.['ho  application  of  the  abovo  theory  is  limited  for 
reasons  which  are  stated  by  Professor  Wiener  in  his  paper  oa 
Prediction  Theory*  Tha  difficulty  begins  to  show  Itself  whoa  m 
search  for  a  concrete  example* 

The  function  |(uj)  turns  out  to  bo  identically  sore  or 
non-oTl stent  in  moat  caaos  that  occur  to  mind  readily-  It  tunic  out 
in  fact  that  if  .la  to  b©  finite  and  net  identic  oily  aero,  the 
frequency  spectrum  of  f(t)  must  he  everywhere  continuous,,  hat 
nowhere  di  .f  f  or  ont  i  abl  a  -  This  implies  that  the  variation  of  f  must 
h©  extremely  ran'icra*  Wiener  gayer  definitely  that  his  method  is  not 
of  us®  with  analytic  functions,  for  these  are  functions  whose  values 
for  all  time  ari  determined  by  email  intervals*  This  fact  would 
®q®hi  aeriously  to  limit  the  method  fox*  solving  the  usual  typ©  of 
differential  ©illation* 

Xn  fact  1  would  say  that  for  improving  truncation  error 
aXono,  the  method  is  not  of  use*  -»’or  round-off,  which  has  this 
random  character,  the  filtering  Idea  may  well  work  if  the  time 
elution  is  also  somewhat  random* 

III*  Conclusions 

l)  Much  more  work  must  be  don©  before  the  ideas  presented 
will  find  application  for  digital  computation*  Their  beet  place  is 
in  minimisation  of  round-off  error* 

3)  It  may  well  be  that  the  non-linear  theory  will 
find  its  us©  mores  easily* 

3)  Concrete  examploc  will  he  hard  to  construct*  If 
f(t)  1®  reasonably  simple,  jj(co)  Ira  useless*  If  f|t (to )  is  at  all 
simple,,  f(t)  la  a  hop  ©lee  sly  messy  function* 


WifflKfifi  50  LOUD 


WSIishass 

c*  MoIoPlorenoourt 
I*  Reich 
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S o rvo rase h&ni  cm  s  Laboratory 
Massachusetts  Institute  of  Technology 
*  Cambridge ,.,  Massachusetts 


To 8  Jay  Forrester  B0  &„  Everett,.. 

Mo  I„  Florancourt*  ProfcoBor  Franklin 

From 3  Edgar  Eeich 

Subject;?  M„A„A0  Sympo slum  on  Computing  Machines,,  Yale  University. 

September  2*  19^7 «  10  A0M0  «*>  IS  H0 

Bates  September  3«  19**7 

The  symposium  consisted  of  two  addreseas*  the  first  by  Hc  H„  Aiken 
of  Harvard*  the  second  by  John  von  Neumann  of  the  Institutes  for  Advanced  Study,, 
followed  by  a  dissuasion,, 

Aiken,  described  the  mechanical  components  of  the  Harvard  machine d0 
Moat  of  this  material  including  the  glides  shown  is  already  available  in  the 
"Manual  of  Operation1’,  Fon  Neumann 9 o  talk  contained  remarks  which  might  be  of 
interest  to  the  Laboratory #  and  excerpts  from  lte  ae  well  as  from  the  discussion 
that  followed,,,  are  summarised  below, 

Up  to  the  present;  no  significant  ouocesa  has  bean  achieved  in  non-linear 
theoiy,  The  typoo  of  singularities  encountered  in  non-linear  eye  toms  are  not 
like  those  of  'linear  systems,*  and  at  tho  present  stago  of  the  art  their  character 
canc  in  moat  caaoe,  only  bo  obtained  by  .physical  experiment  and/or  extenBlve 
computing,  Tha  data  obtained  by  tho  machine  will  enable  ua  to  examine  those 
system® e  add  will  thus  provida  an  Intuitive  guide  for  a  rigorous  mathematical, 
attack,, 

Pro  von  Neumann  compared  analog  to  digital  machines*  in  fl o  far  as 
accuraoy  is  concerned,,  When  two  numbers  are  multiplied  by  an  analog  method,, 
there  la  an  error  Introduced  due  to  the  nolno  level  of  tha  analogous  system  „ 

This  noise  level  1b  of  an  essentlaily  statistics!  nature  „  Physical  limitations 
prevent  an  indefinite  increase  of  tho  accuracy „  Wq  cannot  hop©  for  an.  accuracy 
better  than.  1  part  in  100*000  with  the  analog  typo  of  computer.  In  digital  machines* 
wb  also  have  a  noise*  caused*  In  this  case*  by  tho  rounds? .<1  procedure^  rfi^-h 
this  type  of  computer*  however*  the  affect  of  the  noise  can  be  made  arbitrarily 
small  by  simply  Increasing  the  number  of  digits  tho  machine  handles  Ci.  ®,  Increasing 
the  register  length) „ 
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SeptSMl.-f!?  3,  J?4' 


The  tyrreiopuent  of -off:*  cions  technique's  for  coding  proKL'ma 
Hie  digital  computer  will  make  an  a;; ten. cion  o.t  the  Sio^d  covered  \%  v 
mtlcai,  logic  necessary 0  '  Beany  Mathematical  loilc  require*  nothin*  s 
&  proof  than  that  it  to  valid.,  that  io„  conuist  of  at  hob's  a  Unit'  .3 
at  valid  detections..  JJo  attention  has  been  pail  to  the  actual  .nvmNn 
Auctions*  as  lions  aa  this  is  finite,.  A  proof,,  ox  construct  ion  c  cov.t.- 
nay  live  steps  is  for  'logical  paipoaon  con  aider  3d'  no  hotter  than  ore 
at  five  hundred,  in  the  coding  of  problems  for  digital  computers,,  or. 
hand0  it  is  desirable  to  either  raSnlalae  the  total  number  _ of  steps,.  •■; 
minimise  the  total  number  of  tlmau  a  specified  operation  1  .m«ii  o.s,  j. 
division)  is  used  in  a  particular  cone tract ion,  1‘hia  problem  will  M 
investigated  in  order  to  make  it  possible  to  decide  what  operations  i 
built  into  a  raacM.no,,  and  in  order  to  use  the  storage  capacity  moo* 

In  ©Rawer  to  a  question  as  to  whether  or  not  tho  computer 
used  to  attack  problem  of  number  theory  by  brute  force  (for  instate • 
it  could  bo  used  to  sift  through  enormous  eebs  of  number b  in  search, 
number  with  some  facial  property}1,,  hr„  von  Heum&na  replied  ubat  tM. 
cation  twjuld  be  unlikely.  She  machine  provides  a  time-reduction  feu 
about  10  b  over  human  cojnoutatione  but  tho  nunber  oi  element  a  onoour.  t 
tho  aforementioned  sots  are  often  of  aatroconrcal.  magn.i.t'ud^o  In  ‘-Me 
the  time  .required  might  still  be  too  .long. 

Baring  tho  discussion-,  udmoone  mentioned  the  fact  that  the 
should  bo  able  tc  oolve  certain  "highly  important 15  non-linear  differ 
equations  arising  in  the  theory  of  Evolution, 
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Proj  ec  t  Whirlwind 
Sojrvomechanisins  Laboratory 
Massachusetts  Institute  of  Technolo. gj 
0pjobridgo»  Masaaohusett  s 


SUBJECTS  '  LOCATION  OS'  TAKGET  IBCM  COMBINED  OBSERVATION 

TO  a  Joy  Wo  Forrester,  B.«  H.  Everett 

FBOMg  Philip  Franklin 

DATES  October  21 ,  1947 


The  range  and  direction  of  a  target  T  is  oo served  offl 

several  stations  whoso  location  Is  known,  From  those  observations 
we  wish  to  determine  the  most  probable  position  of  the  targets 
Assuming  that  the  direction  information  has  a  precision  at  least 
comparable  with  the  range  information,  the  following  procedure  leads 
to  a  determination  by  an  application  of  tha  theory  of  least,  squares. 

As  a  first  case,  restrict  matters  to  a  plane  in  which  we 
have  two  stations,  6^  and  Sp0  Introduce  some  fixed  (ay)  coordinate 

system.  Let  ^  Put  ^  ~  S^S,  the  observed  range  from  8^ 

Put  A,  =  aslmnth  of  !3„T  measured  from  the  direction  of  OX,  the  observed 
bearing  from  S^0  Then  the  value  of  Aj  restricts  T  to  a  straight  lino 


whose  equation  io 

(x  -  Xj_)  sin 


y^ )  cos  Aj,  =  0B  or  L^  =  0t 


(1) 


whsre  L^  equals  th©  linear  expression  in  the  left  member.  s.f  the 
probable  error  of  A,  is  dA^,  th©  probable  error  of  distance  from  line 
(X)  near  T  is  3., cby,  Assign  the  squared  reciprocal  of  this, 


w. 


if  (E^dA^)s,  as  a  weight  or  measure  of  precision  for  the  Eq0 


The  value  of  \  restricts  T  to  a  circle  which  we  approximate 
by  its  tangent  at  T„  This  straight  line  has  as  its  equation 

(21  a.  )  cos  Aj  “*■  (y  m  y1 )  sin  Aj  •=*  3^  r":  O'*  or  ^  (2) 

Th©  probable  error  of  distance  from  line  (3)  near  T  is  dR^»  the  probable 
error  of  »  Assign  the  squared  reciprocal  of  this,  =  1/ (dR^)*  as  a 
weight  or  measure  of  precision  for  th©  Eq„  (P)* 
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Similarly  the  observations  &,»  A.,  for  station  S.-,  -:aid  their 
probable  errors  dJUr  d/L  load  to  two  equations  L,  ~  0,  with  a  weight 
vx  aad  1».  ~  0  with  a  weight  ",j, »  She  expressions  for  L,7  and  w  are  like 


’3  "4  "  . .  *"  '•4"  *i' . .  . “3  . .  3 

those  for  and  .  except  that  subscripts  1  are  changed  to  Za 

Similarly,  the  expressions  for  and  are  like  these  for  !0  and  w„0 


According  to  the  theory  of  normal  error b,  the  probability  cf 

*  "  Krf/ 


i?  being  at  a  given  position  (x.y)  is  equal  to.  Ee 


'  where 


*“«iV  +  ’A*  '!"Vj32  ‘“'A2- 


5 he  probability  is  greatest  when  this  is  least,  ,nnd  the  normal  equations 
for  x  and  y  are 

w,  sin  A,  1.  w_  cos  iL  L  -1-  w  sia  A_  L„  -I-  u„  cos  A,,L.  -  0 

X  X  X  3  x  3  fd  O  4~  3  ‘X 

Id) 

««,  cos  JL  L,  ’I-  v;_  sin  A,  L.,  ®wr,  cos  X,  L„  w.  sin  L,  -  0,, 

JL  X  X  <w  Ja  u  O  rV  «5  Q  %l; 

» 

The  solution  of  these  two  linear  equations  x„,  is  to  bo 

fallen  as  the  target  position.,  it  is  the  center  of  a  family  of  similar 
ellipse s0  S  :=  constant,  whero  E  is  the  expression  in  (3)0  .All  points 
on  any  one  ellipse  are  equally  likely  positions  for  T0 

EXAMPLE  Is  Let  w0  -  w.  and  w.  =  w~,>  Here  the  observations  at 

alone  lead  to  a  circular  probability  distribution  with  center  at  a 

•point  we  call  T,  „  and  similarly  those  at  S_  alone  lead  to  circles  with. 

center  at  a  point  we  call  T  »  The  ellipses  13  in  this  case  reduce  to 

circles,  end  the  point  ;qp,  yrp  found  from  Eqc  (4)  is  on  the  line  T-,  T,;. 

with  T..T/T2,  Tg.„jw  » 

X  &  o  1 

EXAMPLE  2s  Let  w_  aad  w„  be  very  large  compared  with  either 

yn  or  nf  jo  Here  x„,  ym  will  be  very  near  the  intersection  of  L„.  and  L  , 

the  position  determined  by  the  bearings  alone,  aid  slightly  biassed 
toward  the  lines  La  and  L, c 

These  two  example e  show  that  the  method  leads  to  plausible 
results  in  simple  Case (5, 
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i  =  X,  3,  3, 


c&l  Problem  in  a  Plane;  lor  n  stations  S^', 
n,  there  are  3a  .  linear  expressions  L.,  ,1  -  X,  3,  3, 

t) 


.  „  .  3n  and  equations  1^  =  0  with  weight e  Wy  For  3  odd»  3  =  ,2i  ~1» 
these  are  formed  from  the  azimuths  similar  to  Eq„  (l)o  For  j  even, 
j  ss  2i,  these  ore  formed  from  the  ranges  similar  to  33q,  (2),  Here  the 
quantity  E,  such  that  Inconstant  a  gives  ellipses  of  equal  probability,  la 


i  =  i 


i  =  i 
n  ^ 


<«2i-l  8in  Ai  Vl  +  ”21  cos  W  =  0 


^“w21-l  C0B  V  L21-l  +  "si  oi“  Ai  L?,ll  =  °*  ' 


As  in  Example  1,  if  each  =  ^gi-l*  ^e  observations  for  each 
alone  lead  to  a  circular  distribution,  and  x^,,  y^,  is  the  center  of 
gravity  of  n  weights  where  w.^  is  placed  at  the  point  determined  by 
the  observations  at  alone,  i„e»,  the  intersection  of  the  lines  =  0 

and  =  0„  The  ellipses  E  =  constant  reduce  to  criUrtlesia 

Three-Dimensional  Case :  Consider  a  station  in  space  whose 
coordinates  are  x^,  y^,  z^  with  respect  to  some  fixed  xyz  system.  Let  a 
target  be  located  by  its  observed  range  =  S^T,  azimuth  of  the  vertical 
plane  through  S^T  measured  from  the  xz  plane,  taken  as  ,  and  polar 
declination  or  colatitude  equal  to  the  angle  from  the  direction  of  02  to 
SjT,  Then  the  value  of  A^  restricts  T  to  a  plane  whose  equation  is  «  0, 

where 

1^  =  (x  -  a^)  sin  A^  -  (y  -  y^)  cos  A^ ,  (7) 

The  weight  is  the  square  reciprocal  of  the  probable  error  of  distance 
from  the  plane,  ~  l/(R^  sin  B^dA^)3,. 

j  • 

The  value  of  B^  restricts  T/fco  the  plane  L,,  =  0,  where 
Lg  =  (x  »  s^)  cos  cos  4  (y  »  y^)  sin  A^  cos  B^  -  (a  -  s^)  sin  B^, 

The  probable  error  of  distance  is  dB^,  bo  that  the  weight 

w2  88  ^1^ 


i;jJ' ;, \  •!^:^,<.*:i^;.^5;:!t^w 


r:'M,f.^^iif*il]"5j»W-ijPti?:-vf^*!,|'T»«*»*|! 
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She  value  of  H  restricts  T  to  the  plane  lg  -  0*  where 

Lg  =  (x  «■  x^)  cob  A^  sin  B.(  +  (y  --  y^ )  Bin  A^  sin  B^  Jr  (a  ~  z^)  cob  II  «  .2.^  ( 

The  probable  error  of  distance  is  <5^,  and  the  weight  Wg  =  l/(dR^)3., 


'% 


If  there  are  n  stations  S^,  for  9ach  station,  we  can  form  three 

expressions  Lg^  Lg^  ., ,  and  Lg^  like  1^,  Lg,  lg  and  corresponding  weights 

like  w, ,  w~,  w„e  With  revised  notation,  we  have  3a  linear  expressions 
13  3 

Lj  and  equations  lj  =  0  with  weights  w..  where 

(10) 


sa  SjX  +  b^y  +  CjZ  -  dj» 


4d3 


The  probability  that  T  is  at  x,y,z  is  now  P  a  K  0  >  where 

3n 

~  a 


E  a 


J  *1 


MJLJ 


(11) 


E  a  constant  gives  the  ellipsoids  of  equal  probabili^o  And  the  value 
Xpt  y^,  which  makes  P  a  maximum,  maices  S  a  minimum  and  satisfies  the 


normal  equations 
3n 


J  = 

3n 


WJ  aJ  L  j  “  ° 


V'j  *d  LJ  =  ° 


(13) 


3  =  1 
3n 


*3  °J  LJ 


Oc 


J  - 1 


Examples;  If  each  »a  =  *3i„x  =  v31„3»  tbs  observations  for 
each  alone  lead  to  a  spherical  distribution.,  "  fhe  ellipsoids  E  =  constant 
reduce  to  spheres-  The  point  s^,  JFrp  ’A$j»  the  center  of  gravity  of 
tt  weights  v,.  where  w_,  is  placed  at  the  point  determined  by  the  observations 

ox  tjX 

at  aloner  i„e.,  the  intersection  of  the  three  plena s 

Lrr,  n  «  0,  L„.  -  =  0,  L„,  =  0, 


31-2 


31~X 


”3i 


As  a  second  example,  let  there  be  just  t\fO  stations,  and  let 
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w„  and  v;,.  be  much  smaller  than  the  other  weights*  Also  let  w„  -  w,  and 
•3  o  2  1 

Wg  =  w^o  '-Chen  y^t  as  found  from  the  normal  equations  (13)  will  be 
vary  near  the  common  perpendicular  to  the  lines  S-P  and  S P  obtained  by 

X  X  it  <j 


using  directions  only*  And  if  the  common  perpendicular  is  P.,P?a 


it  will 


be  near  £,  where  P1rJ?/TP^  =  w „/%,  ® 


"4'  "1' 


The  method  again  leads  to  reasonable  results  in  these  simple 


cases* 


Calculation  in  the  Plane;  In  the  plane  case,  it  might  simplify 

the  computation  to  replace  the  coefficients  sin  A,,  cos  A.  by  tan  A, , 

XXX 

1  or  1,  cot  A1  c  This  is  theoretically  not  correct,  but  since  the  weights 
are  known  only  approximately,  if  we  always  changed  the  biggest  of  sine  or 
cosine  to  unity,  we  would  be  only  changing  the  weights  by  a  factor  between 
0*5  and  1,  which  might  not  be  too  serious* 


J 

Philip  franklin 


PH’s  has 


